paper-with-me

홈 › Papers

Inference-Time Selective Debiasing

2024-07-27 · Gleb Kuzmin, Neemesh Yadav, Ivan Smirnov, Timothy Baldwin, Artem Shelmanov

We propose selective debiasing -- an inference-time safety mechanism that aims to increase the overall quality of models in terms of prediction performance and fairness in the situation when re-training a model is prohibitive. The method is inspired by selective prediction, where some predictions that are considered low quality are discarded at inference time. In our approach, we identify the potentially biased model predictions and, instead of discarding them, we debias them using LEACE -- a post-processing debiasing method. To select problematic predictions, we propose a bias quantification approach based on KL divergence, which achieves better results than standard UQ methods. Experiments with text classification datasets demonstrate that selective debiasing helps to close the performance gap between post-processing methods and at-training and pre-processing debiasing techniques.

📄 PDF Abstract BibTeX arXiv:2407.19345

Code (0)

등록된 구현이 없습니다.

Tasks

Fairnesstext-classificationText Classification

Similar Papers 제목 키워드 기반

Beyond Spurious Signals: Debiasing Multimodal Large Language Models via Counterfactual Inference and Adaptive Expert Routing

2025-09-18 · Zichen Wu, Hsiu-Yuan Huang, Yunfang Wu arxiv

Multimodal Large Language Models (MLLMs) have shown substantial capabilities in integrating visual and textual information, yet frequently rely on spurious correlations, undermining their robustness and generalization in…

Multimodal ReasoningSentiment AnalysisSarcasm Detection

Selective Test-Time Debiasing for CLIP via Reward Gating

2026-07-01 · Jaeho Han, Jisoo Yang, Hyeondong Woo, Mingyu Jeon 외 arxiv

Vision language models (VLMs) demonstrate strong zero-shot performance, but often perpetuate social stereotypes in person-centric queries, yielding skewed demographic distributions. Current debiasing methods apply unifor…

Reinforcement LearningTest-time Adaptation

Selective Query-guided Debiasing for Video Corpus Moment Retrieval

2022-10-17 · Sunjae Yoon, Ji Woo Hong, Eunseop Yoon, Dahyun Kim 외

Video moment retrieval (VMR) aims to localize target moments in untrimmed videos pertinent to a given textual query. Existing retrieval systems tend to rely on retrieval bias as a shortcut and thus, fail to sufficiently …

Moment RetrievalRetrievalVideo Corpus Moment Retrieval

Domain Information Control at Inference Time for Acoustic Scene Classification

2023-06-13 · Shahed Masoudian, Khaled Koutini, Markus Schedl, Gerhard Widmer 외

Domain shift is considered a challenge in machine learning as it causes significant degradation of model performance. In the Acoustic Scene Classification task (ASC), domain shift is mainly caused by different recording …

Acoustic Scene ClassificationDomain GeneralizationScene Classification

Debiasing Masks: A New Framework for Shortcut Mitigation in NLU

2022-10-28 · Johannes Mario Meissner, Saku Sugawara, Akiko Aizawa

Debiasing language models from unwanted behaviors in Natural Language Understanding tasks is a topic with rapidly increasing interest in the NLP community. Spurious statistical correlations in the data allow models to pe…

Natural Language Understanding