paper-with-me

홈 › Papers

Unbiased Classification through Bias-Contrastive and Bias-Balanced Learning

2021-12-01 · NeurIPS 2021 12 · Youngkyu Hong, Eunho Yang

Datasets for training machine learning models tend to be biased unless the data is collected with complete care. In such a biased dataset, models are susceptible to making predictions based on the biased features of the data. The biased model fails to generalize to the case where correlations between biases and targets are shifted. To mitigate this, we propose Bias-Contrastive (BiasCon) loss based on the contrastive learning framework, which effectively leverages the knowledge of bias labels. We further suggest Bias-Balanced (BiasBal) regression which trains the classification model toward the data distribution with balanced target-bias correlation. Furthermore, we propose Soft Bias-Contrastive (SoftCon) loss which handles the dataset without bias labels by softening the pair assignment of the BiasCon loss based on the distance in the feature space of the bias-capturing model. Our experiments show that our proposed methods significantly improve previous debiasing methods in various realistic datasets.

📄 PDF Abstract BibTeX

Code (1)

grayhong/bias-contrastive-learning 공식 구현 pytorch

Tasks

ClassificationContrastive Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Unbiased Contrastive Divergence Algorithm for Training Energy-Based Latent Variable Models

2020-05-01 · ICLR 2020 1 · Yixuan Qiu, Lingsong Zhang, Xiao Wang

The contrastive divergence algorithm is a popular approach to training energy-based latent variable models, which has been widely used in many machine learning models such as the restricted Boltzmann machines and deep be…

uCTRL: Unbiased Contrastive Representation Learning via Alignment and Uniformity for Collaborative Filtering

2023-05-22 · Jae-woong Lee, Seongmin Park, Mincheol Yoon, Jongwuk Lee

Because implicit user feedback for the collaborative filtering (CF) models is biased toward popular items, CF models tend to yield recommendation lists with popularity bias. Previous studies have utilized inverse propens…

Causal InferenceCollaborative FilteringRepresentation Learning

Training Debiased Subnetworks with Contrastive Weight Pruning

2022-10-11 · CVPR 2023 1 · Geon Yeong Park, Sangmin Lee, Sang Wan Lee, Jong Chul Ye

Neural networks are often biased to spuriously correlated features that provide misleading statistical evidence that does not generalize. This raises an interesting question: ``Does an optimal unbiased functional subnetw…

Facial Attribute Classification

Contrastive Learning with Negative Sampling Correction

2024-01-13 · Lu Wang, Chao Du, Pu Zhao, Chuan Luo 외

As one of the most effective self-supervised representation learning methods, contrastive learning (CL) relies on multiple negative pairs to contrast against each positive pair. In the standard practice of contrastive le…

Contrastive LearningData AugmentationGraph ClassificationRepresentation Learning

Visual Encoding and Debiasing for CTR Prediction

2022-05-09 · Si Chen, Chen Lin, Wanxian Guan, Jiayi Wei 외

Extracting expressive visual features is crucial for accurate Click-Through-Rate (CTR) prediction in visual search advertising systems. Current commercial systems use off-the-shelf visual encoders to facilitate fast onli…

Click-Through Rate PredictionContrastive LearningPredictionSelection bias