paper-with-me

홈 › Papers

Batch Decorrelation for Active Metric Learning

2020-05-20 · Priyadarshini K, Ritesh Goru, Siddhartha Chaudhuri, Subhasis Chaudhuri

We present an active learning strategy for training parametric models of distance metrics, given triplet-based similarity assessments: object $x_i$ is more similar to object $x_j$ than to $x_k$. In contrast to prior work on class-based learning, where the fundamental goal is classification and any implicit or explicit metric is binary, we focus on {\em perceptual} metrics that express the {\em degree} of (dis)similarity between objects. We find that standard active learning approaches degrade when annotations are requested for {\em batches} of triplets at a time: our studies suggest that correlation among triplets is responsible. In this work, we propose a novel method to {\em decorrelate} batches of triplets, that jointly balances informativeness and diversity while decoupling the choice of heuristic for each criterion. Experiments indicate our method is general, adaptable, and outperforms the state-of-the-art.

📄 PDF Abstract BibTeX arXiv:2005.10008

Code (1)

kpriyadarshini/BatchAML_Decorrelation pytorch

Tasks

Active LearningDiversityInformativenessMetric LearningTriplet

Similar Papers 제목 키워드 기반

A Unified Batch Selection Policy for Active Metric Learning

2021-02-15 · Priyadarshini K, Siddhartha Chaudhuri, Vivek Borkar, Subhasis Chaudhuri

Active metric learning is the problem of incrementally selecting high-utility batches of training data (typically, ordered triplets) to annotate, in order to progressively improve a learned model of a metric over some in…

Active LearningDiversityInformativenessMetric Learning+1

Scalable and Effective Deep CCA via Soft Decorrelation

2017-07-30 · CVPR 2018 6 · Xiaobin Chang, Tao Xiang, Timothy M. Hospedales

Recently the widely used multi-view learning model, Canonical Correlation Analysis (CCA) has been generalised to the non-linear setting via deep neural networks. Existing deep CCA models typically first decorrelate the f…

MULTI-VIEW LEARNING

Regularizing CNNs with Locally Constrained Decorrelations

2016-11-07 · Pau Rodríguez, Jordi Gonzàlez, Guillem Cucurull, Josep M. Gonfaus 외

Regularization is key for deep learning since it allows training more complex models while keeping lower levels of overfitting. However, the most prevalent regularizations do not leverage all the capacity of the models s…

Decorrelation using Optimal Transport

2023-07-11 · Malte Algren, John Andrew Raine, Tobias Golling

Being able to decorrelate a feature space from protected attributes is an area of active research and study in ethics, fairness, and also natural sciences. We introduce a novel decorrelation method using Convex Neural Op…

Binary ClassificationEthicsFairnessNormalising Flows

Improving Generalization of Batch Whitening by Convolutional Unit Optimization

2021-08-24 · ICCV 2021 10 · Yooshin Cho, Hanbyel Cho, Youngsoo Kim, Junmo Kim

Batch Whitening is a technique that accelerates and stabilizes training by transforming input features to have a zero mean (Centering) and a unit variance (Scaling), and by removing linear correlation between channels (D…

image-classificationImage Classification