01 December 2022
What distinguishes Owen Wilson from Beyoncé? There are a whole host of possible features – age, hair-color, gender, etc… But neural nets will generally focus on the easiest feature they can find; in this instance, maybe the glasses. So, instead of an Owen Wilson-vs-Beyoncé classifier, we may end up with a mere eyeglasses detector.
To solve this, Aligned AI developed acCElerate to identify the different features that explain a classification. Even if the labeled training data has a perfect correlation – even if all blonds wear glasses and all non-blonds don’t – AcCElerate is capable of distinguishing the two features and training a different classifier for each.
AcCElerate can then select the most ambiguous unlabeled images – the ones on which the two classifiers disagree the most – and get a human to select the correct classifier by choosing which category those ambiguous images belong to.
In the following five illustrative sets, the diagonal images – top left and bottom right – are those images with features correlated. The off-diagonal images – bottom left and top right – are the most ambiguous images, where the two classifiers disagree.