Batch Decorrelation for Active Metric Learning
We present an active learning strategy for training parametric models of distance metrics, given triplet-based similarity assessments: object $x_i$ is more similar to object $x_j$ than to $x_k$. In contrast to prior work on class-based learning, where the fundamental goal is classification and any implicit or explicit metric is binary, we focus on {\em perceptual} metrics that express the {\em degree} of (dis)similarity between objects. We find that standard active learning approaches degrade when annotations are requested for {\em batches} of triplets at a time: our studies suggest that correlation among triplets is responsible. In this work, we propose a novel method to {\em decorrelate} batches of triplets, that jointly balances informativeness and diversity while decoupling the choice of heuristic for each criterion. Experiments indicate our method is general, adaptable, and outperforms the state-of-the-art.
Code (1)
Tasks
Active LearningDiversityInformativenessMetric LearningTripletSimilar Papers 제목 키워드 기반
A Unified Batch Selection Policy for Active Metric Learning
Active metric learning is the problem of incrementally selecting high-utility batches of training data (typically, ordered triplets) to annotate, in order to progressively improve a learned model of a metric over some in…
Active LearningDiversityInformativenessMetric Learning+1Scalable and Effective Deep CCA via Soft Decorrelation
Recently the widely used multi-view learning model, Canonical Correlation Analysis (CCA) has been generalised to the non-linear setting via deep neural networks. Existing deep CCA models typically first decorrelate the f…
MULTI-VIEW LEARNINGRegularizing CNNs with Locally Constrained Decorrelations
Regularization is key for deep learning since it allows training more complex models while keeping lower levels of overfitting. However, the most prevalent regularizations do not leverage all the capacity of the models s…
Decorrelation using Optimal Transport
Being able to decorrelate a feature space from protected attributes is an area of active research and study in ethics, fairness, and also natural sciences. We introduce a novel decorrelation method using Convex Neural Op…
Binary ClassificationEthicsFairnessNormalising FlowsImproving Generalization of Batch Whitening by Convolutional Unit Optimization
Batch Whitening is a technique that accelerates and stabilizes training by transforming input features to have a zero mean (Centering) and a unit variance (Scaling), and by removing linear correlation between channels (D…
image-classificationImage Classification