paper-with-me

Papers

Mitigating Calibration Bias Without Fixed Attribute Grouping for Improved Fairness in Medical Imaging Analysis

2023-07-04 · Changjian Shui, Justin Szeto, Raghav Mehta, Douglas L. Arnold, Tal Arbel

Trustworthy deployment of deep learning medical imaging models into real-world clinical practice requires that they be calibrated. However, models that are well calibrated overall can still be poorly calibrated for a sub-population, potentially resulting in a clinician unwittingly making poor decisions for this group based on the recommendations of the model. Although methods have been shown to successfully mitigate biases across subgroups in terms of model accuracy, this work focuses on the open problem of mitigating calibration biases in the context of medical image analysis. Our method does not require subgroup attributes during training, permitting the flexibility to mitigate biases for different choices of sensitive attributes without re-training. To this end, we propose a novel two-stage method: Cluster-Focal to first identify poorly calibrated samples, cluster them into groups, and then introduce group-wise focal loss to improve calibration bias. We evaluate our method on skin lesion classification with the public HAM10000 dataset, and on predicting future lesional activity for multiple sclerosis (MS) patients. In addition to considering traditional sensitive attributes (e.g. age, sex) with demographic subgroups, we also consider biases among groups with different image-derived attributes, such as lesion load, which are required in medical image analysis. Our results demonstrate that our method effectively controls calibration error in the worst-performing subgroups while preserving prediction performance, and outperforming recent baselines.

📄 PDF Abstract BibTeX arXiv:2307.01738

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeFairnessLesion ClassificationMedical Image AnalysisSkin Lesion Classification

Methods 이 논문이 사용한 방법론

Focal Loss A Focal Loss function addresses class imbalance during training in tasks like object detection. Focal loss applies a modulating term to the cross entropy loss in order to…

Similar Papers 제목 키워드 기반

Mitigating Political Bias in Language Models Through Reinforced Calibration

2021-04-30 · Ruibo Liu, Chenyan Jia, Jason Wei, Guangxuan Xu 외

Current large-scale language models can be politically biased as a result of the data they are trained on, potentially causing serious problems when they are deployed in real-world settings. In this paper, we describe me…

reinforcement-learningReinforcement Learning (RL)Word Embeddings

Mitigating Object Hallucinations in Large Vision-Language Models via Attention Calibration

2025-02-04 · Younan Zhu, Linwei Tao, Minjing Dong, Chang Xu

Large Vision-Language Models (LVLMs) exhibit impressive multimodal reasoning capabilities but remain highly susceptible to object hallucination, where models generate responses that are not factually aligned with the vis…

AttributeHallucinationMultimodal ReasoningObject+2

One-Frame Calibration with Siamese Network in Facial Action Unit Recognition

2024-08-30 · Shuangquan Feng, Virginia R. de Sa arxiv

Automatic facial action unit (AU) recognition is used widely in facial expression analysis. Most existing AU recognition systems aim for cross-participant non-calibrated generalization (NCG) to unseen faces without furth…

Resampled Datasets Are Not Enough: Mitigating Societal Bias Beyond Single Attributes

2024-07-04 · Yusuke Hirota, Jerone T. A. Andrews, Dora Zhao, Orestis Papakyriakopoulos 외

We tackle societal bias in image-text datasets by removing spurious correlations between protected groups and image attributes. Traditional methods only target labeled attributes, ignoring biases from unlabeled ones. Usi…

Image Captioningimage-classificationImage ClassificationMulti-Label Image Classification

Mitigating Label Biases for In-context Learning

2023-05-28 · Yu Fei, Yifan Hou, Zeming Chen, Antoine Bosselut

Various design settings for in-context learning (ICL), such as the choice and order of the in-context examples, can bias a model toward a particular prediction without being reflective of an understanding of the task. Wh…

In-Context Learningtext-classificationText Classification