Unbiased Classification through Bias-Contrastive and Bias-Balanced Learning
Datasets for training machine learning models tend to be biased unless the data is collected with complete care. In such a biased dataset, models are susceptible to making predictions based on the biased features of the data. The biased model fails to generalize to the case where correlations between biases and targets are shifted. To mitigate this, we propose Bias-Contrastive (BiasCon) loss based on the contrastive learning framework, which effectively leverages the knowledge of bias labels. We further suggest Bias-Balanced (BiasBal) regression which trains the classification model toward the data distribution with balanced target-bias correlation. Furthermore, we propose Soft Bias-Contrastive (SoftCon) loss which handles the dataset without bias labels by softening the pair assignment of the BiasCon loss based on the distance in the feature space of the bias-capturing model. Our experiments show that our proposed methods significantly improve previous debiasing methods in various realistic datasets.
Code (1)
Tasks
ClassificationContrastive LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Unbiased Contrastive Divergence Algorithm for Training Energy-Based Latent Variable Models
The contrastive divergence algorithm is a popular approach to training energy-based latent variable models, which has been widely used in many machine learning models such as the restricted Boltzmann machines and deep be…
uCTRL: Unbiased Contrastive Representation Learning via Alignment and Uniformity for Collaborative Filtering
Because implicit user feedback for the collaborative filtering (CF) models is biased toward popular items, CF models tend to yield recommendation lists with popularity bias. Previous studies have utilized inverse propens…
Causal InferenceCollaborative FilteringRepresentation LearningTraining Debiased Subnetworks with Contrastive Weight Pruning
Neural networks are often biased to spuriously correlated features that provide misleading statistical evidence that does not generalize. This raises an interesting question: ``Does an optimal unbiased functional subnetw…
Facial Attribute ClassificationContrastive Learning with Negative Sampling Correction
As one of the most effective self-supervised representation learning methods, contrastive learning (CL) relies on multiple negative pairs to contrast against each positive pair. In the standard practice of contrastive le…
Contrastive LearningData AugmentationGraph ClassificationRepresentation LearningVisual Encoding and Debiasing for CTR Prediction
Extracting expressive visual features is crucial for accurate Click-Through-Rate (CTR) prediction in visual search advertising systems. Current commercial systems use off-the-shelf visual encoders to facilitate fast onli…
Click-Through Rate PredictionContrastive LearningPredictionSelection bias