paper-with-me

홈 › Papers

Discover and Cure: Concept-aware Mitigation of Spurious Correlation

2023-05-01 · Shirley Wu, Mert Yuksekgonul, Linjun Zhang, James Zou

Deep neural networks often rely on spurious correlations to make predictions, which hinders generalization beyond training environments. For instance, models that associate cats with bed backgrounds can fail to predict the existence of cats in other environments without beds. Mitigating spurious correlations is crucial in building trustworthy models. However, the existing works lack transparency to offer insights into the mitigation process. In this work, we propose an interpretable framework, Discover and Cure (DISC), to tackle the issue. With human-interpretable concepts, DISC iteratively 1) discovers unstable concepts across different environments as spurious attributes, then 2) intervenes on the training data using the discovered concepts to reduce spurious correlation. Across systematic experiments, DISC provides superior generalization ability and interpretability than the existing approaches. Specifically, it outperforms the state-of-the-art methods on an object recognition task and a skin-lesion classification task by 7.5% and 9.6%, respectively. Additionally, we offer theoretical analysis and guarantees to understand the benefits of models trained by DISC. Code and data are available at https://github.com/Wuyxin/DISC.

📄 PDF Abstract BibTeX arXiv:2305.00650

Code (1)

wuyxin/disc 공식 구현 pytorch

Tasks

Lesion ClassificationObject RecognitionSkin Lesion Classification

Methods 이 논문이 사용한 방법론

fail 설명 없음

Similar Papers 제목 키워드 기반

Unsupervised Concept Discovery Mitigates Spurious Correlations

2024-02-20 · Md Rifat Arefin, Yan Zhang, Aristide Baratin, Francesco Locatello 외

Models prone to spurious correlations in training data often produce brittle predictions and introduce unintended biases. Addressing this challenge typically involves methods relying on prior knowledge and group annotati…

Representation Learning

Learning Robust Classifiers with Self-Guided Spurious Correlation Mitigation

2024-05-06 · Guangtao Zheng, Wenqian Ye, Aidong Zhang

Deep neural classifiers tend to rely on spurious correlations between spurious attributes of inputs and targets to make predictions, which could jeopardize their generalization capability. Training classifiers robust to …

Attribute

SECURE: Semantics-aware Embodied Conversation under Unawareness for Lifelong Robot Learning

2024-09-26 · Rimvydas Rubavicius, Peter David Fagan, Alex Lascarides, Subramanian Ramamoorthy

This paper addresses a challenging interactive task learning scenario we call rearrangement under unawareness: to manipulate a rigid-body environment in a context where the agent is unaware of a concept that is key to so…

Novel ConceptsSentence

FACTS: First Amplify Correlations and Then Slice to Discover Bias

2023-09-29 · ICCV 2023 1 · Sriram Yenamandra, Pratik Ramesh, Viraj Prabhu, Judy Hoffman

Computer vision datasets frequently contain spurious correlations between task-relevant labels and (easy to learn) latent task-irrelevant attributes (e.g. context). Models trained on such datasets learn "shortcuts" and u…

ViG-Bias: Visually Grounded Bias Discovery and Mitigation

2024-07-02 · Badr-Eddine Marani, Mohamed Hanini, Nihitha Malayarukil, Stergios Christodoulidis 외

The proliferation of machine learning models in critical decision making processes has underscored the need for bias discovery and mitigation strategies. Identifying the reasons behind a biased system is not straightforw…