paper-with-me

Papers

Mitigating Label Bias via Decoupled Confident Learning

2023-07-18 · Yunyi Li, Maria De-Arteaga, Maytal Saar-Tsechansky

Growing concerns regarding algorithmic fairness have led to a surge in methodologies to mitigate algorithmic bias. However, such methodologies largely assume that observed labels in training data are correct. This is problematic because bias in labels is pervasive across important domains, including healthcare, hiring, and content moderation. In particular, human-generated labels are prone to encoding societal biases. While the presence of labeling bias has been discussed conceptually, there is a lack of methodologies to address this problem. We propose a pruning method -- Decoupled Confident Learning (DeCoLe) -- specifically designed to mitigate label bias. After illustrating its performance on a synthetic dataset, we apply DeCoLe in the context of hate speech detection, where label bias has been recognized as an important challenge, and show that it successfully identifies biased labels and outperforms competing approaches.

📄 PDF Abstract BibTeX arXiv:2307.08945

Code (0)

등록된 구현이 없습니다.

Tasks

FairnessHate Speech Detection

Methods 이 논문이 사용한 방법론

Pruning 설명 없음

Similar Papers 제목 키워드 기반

Mitigating Label Bias in Machine Learning: Fairness through Confident Learning

2023-12-14 · Yixuan Zhang, Boyu Li, Zenan Ling, Feng Zhou

Discrimination can occur when the underlying unbiased labels are overwritten by an agent with potential bias, resulting in biased datasets that unfairly harm specific groups and cause classifiers to inherit these biases.…

Fairness

Bias-Aware Mislabeling Detection via Decoupled Confident Learning

2025-07-09 · Yunyi Li, Maria De-Arteaga, Maytal Saar-Tsechansky arxiv

Reliable data is a cornerstone of modern organizational systems. A notable data integrity challenge stems from label bias, which refers to systematic errors in a label, a covariate that is central to a quantitative analy…

Hate Speech DetectionLabel Error Detection

Err on the Side of Texture: Texture Bias on Real Data

2024-12-13 · Blaine Hoak, Ryan Sheatsley, Patrick McDaniel

Bias significantly undermines both the accuracy and trustworthiness of machine learning models. To date, one of the strongest biases observed in image classification models is texture bias-where models overly rely on tex…

image-classificationImage Classification

Decoupled Prototype Learning for Reliable Test-Time Adaptation

2024-01-15 · Guowei Wang, Changxing Ding, Wentao Tan, Mingkui Tan

Test-time adaptation (TTA) is a task that continually adapts a pre-trained source model to the target domain during inference. One popular approach involves fine-tuning model with cross-entropy loss according to estimate…

Domain GeneralizationTest-time Adaptation

Rethinking Noisy Label Learning in Real-world Annotation Scenarios from the Noise-type Perspective

2023-07-28 · Renyu Zhu, Haoyu Liu, Runze Wu, Minmin Lin 외

In this paper, we investigate the problem of learning with noisy labels in real-world annotation scenarios, where noise can be categorized into two types: factual noise and ambiguity noise. To better distinguish these no…

Learning with noisy labels