paper-with-me

Papers

Learning Debiased Classifier with Biased Committee

2022-06-22 · Nayeong Kim, Sehyun Hwang, Sungsoo Ahn, Jaesik Park, Suha Kwak

Neural networks are prone to be biased towards spurious correlations between classes and latent attributes exhibited in a major portion of training data, which ruins their generalization capability. We propose a new method for training debiased classifiers with no spurious attribute label. The key idea is to employ a committee of classifiers as an auxiliary module that identifies bias-conflicting data, i.e., data without spurious correlation, and assigns large weights to them when training the main classifier. The committee is learned as a bootstrapped ensemble so that a majority of its classifiers are biased as well as being diverse, and intentionally fail to predict classes of bias-conflicting data accordingly. The consensus within the committee on prediction difficulty thus provides a reliable cue for identifying and weighting bias-conflicting data. Moreover, the committee is also trained with knowledge transferred from the main classifier so that it gradually becomes debiased along with the main classifier and emphasizes more difficult data as training progresses. On five real-world datasets, our method outperforms prior arts using no spurious attribute label like ours and even surpasses those relying on bias labels occasionally.

📄 PDF Abstract BibTeX arXiv:2206.10843

Code (1)

nayeong-v-kim/lwbc 공식 구현 pytorch

Tasks

Attribute

Similar Papers 제목 키워드 기반

Debiased Learning from Naturally Imbalanced Pseudo-Labels

2022-01-05 · CVPR 2022 1 · Xudong Wang, Zhirong Wu, Long Lian, Stella X. Yu

Pseudo-labels are confident predictions made on unlabeled target data by a classifier trained on labeled source data. They are widely used for adapting a model to unlabeled data, e.g., in a semi-supervised learning setti…

counterfactualCounterfactual ReasoningFew-Shot Image Classificationimbalanced classification+2

BiasEdit: A Training-Free Bias-Detect-and-Edit Framework for Learning Fair Visual Classifiers

2026-05-27 · Jungwook Seo, Yoonsik Park, Changmin Lee, Sungyong Baik arxiv

Visual data from the Web power image classifiers, which often underpin many web services, such as recommendation and content moderation. However, the raw Web data often contain spurious correlations and social biases, an…

Image ClassificationImage Editing

(Debiased) Contrastive Learning Loss for Recommendation (Technical Report)

2023-12-13 · Ruoming Jin, Dong Li

In this paper, we perform a systemic examination of the recommendation losses, including listwise (softmax), pairwise(BPR), and pointwise (mean-squared error, MSE, and Cosine Contrastive Loss, CCL) losses through the len…

Contrastive Learning

Revisiting Recommendation Loss Functions through Contrastive Learning (Technical Report)

2023-12-13 · Dong Li, Ruoming Jin, Bin Ren

Inspired by the success of contrastive learning, we systematically examine recommendation losses, including listwise (softmax), pairwise (BPR), and pointwise (MSE and CCL) losses. In this endeavor, we introduce InfoNCE+,…

Contrastive Learning

Triple/Debiased Lasso for Statistical Inference of Conditional Average Treatment Effects

2024-03-05 · Masahiro Kato

This study investigates the estimation and the statistical inference about Conditional Average Treatment Effects (CATEs), which have garnered attention as a metric representing individualized causal effects. In our data-…

regression