paper-with-me

홈 › Papers

A Contrastive Learning Approach to Mitigate Bias in Speech Models

2024-06-20 · Alkis Koudounas, Flavio Giobergia, Eliana Pastor, Elena Baralis

Speech models may be affected by performance imbalance in different population subgroups, raising concerns about fair treatment across these groups. Prior attempts to mitigate unfairness either focus on user-defined subgroups, potentially overlooking other affected subgroups, or do not explicitly improve the internal representation at the subgroup level. This paper proposes the first adoption of contrastive learning to mitigate speech model bias in underperforming subgroups. We employ a three-level learning technique that guides the model in focusing on different scopes for the contrastive loss, i.e., task, subgroup, and the errors within subgroups. The experiments on two spoken language understanding datasets and two languages demonstrate that our approach improves internal subgroup representations, thus reducing model bias and enhancing performance.

📄 PDF Abstract BibTeX arXiv:2406.14686

Code (1)

koudounasalkis/CLUES 공식 구현 pytorch

Tasks

Contrastive LearningSpoken Language Understanding

Methods 이 논문이 사용한 방법론

Focus 설명 없음
Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

FairASR: Fair Audio Contrastive Learning for Automatic Speech Recognition

2025-06-12 · Jongsuk Kim, Jaemyung Yu, Minchan Kwon, Junmo Kim

Large-scale ASR models have achieved remarkable gains in accuracy and robustness. However, fairness issues remain largely unaddressed despite their critical importance in real-world applications. In this work, we introdu…

Automatic Speech RecognitionContrastive LearningFairnessspeech-recognition+1

Comparative Evaluation of Label-Agnostic Selection Bias in Multilingual Hate Speech Datasets

2020-11-01 · EMNLP 2020 11 · Nedjma Ousidhoum, Yangqiu Song, Dit-yan Yeung

Work on bias in hate speech typically aims to improve classification performance while relatively overlooking the quality of the data. We examine selection bias in hate speech in a language and label independent fashion.…

Hate Speech DetectionSelection biasSemantic SimilaritySemantic Textual Similarity+1

Contrastive Decoding Mitigates Score Range Bias in LLM-as-a-Judge

2025-10-21 · Yoshinari Fujinuma arxiv

Large Language Models (LLMs) are commonly used as evaluators in various applications, but the reliability of the outcomes remains a challenge. One such challenge is using LLMs-as-judges for direct assessment, i.e., assig…

Unbiased Classification through Bias-Contrastive and Bias-Balanced Learning

2021-12-01 · NeurIPS 2021 12 · Youngkyu Hong, Eunho Yang

Datasets for training machine learning models tend to be biased unless the data is collected with complete care. In such a biased dataset, models are susceptible to making predictions based on the biased features of the …

ClassificationContrastive Learning

Relative Counterfactual Contrastive Learning for Mitigating Pretrained Stance Bias in Stance Detection

2024-05-16 · Jiarui Zhang, Shaojuan Wu, Xiaowang Zhang, Zhiyong Feng

Stance detection classifies stance relations (namely, Favor, Against, or Neither) between comments and targets. Pretrained language models (PLMs) are widely used to mine the stance relation to improve the performance of …

Contrastive LearningcounterfactualLanguage ModelingLanguage Modelling+2