Spurious Correlations in Machine Learning: A Survey
Machine learning systems are known to be sensitive to spurious correlations between non-essential features of the inputs (e.g., background, texture, and secondary objects) and the corresponding labels. These features and their correlations with the labels are known as "spurious" because they tend to change with shifts in real-world data distributions, which can negatively impact the model's generalization and robustness. In this paper, we provide a review of this issue, along with a taxonomy of current state-of-the-art methods for addressing spurious correlations in machine learning models. Additionally, we summarize existing datasets, benchmarks, and metrics to aid future research. The paper concludes with a discussion of the recent advancements and future challenges in this field, aiming to provide valuable insights for researchers in the related domains.
Code (1)
Tasks
SurveySimilar Papers 제목 키워드 기반
The Multiple Dimensions of Spuriousness in Machine Learning
Learning correlations from data forms the foundation of today's machine learning (ML) and artificial intelligence (AI) research. While such an approach enables the automatic discovery of patterned relationships within bi…
FairnessOut of spuriousity: Improving robustness to spurious correlations without group annotations
Machine learning models are known to learn spurious correlations, i.e., features having strong relations with class labels but no causal relation. Relying on those correlations leads to poor performance in the data group…
AttributeUnderstanding and Mitigating Spurious Correlations in Text Classification with Neighborhood Analysis
Recent research has revealed that machine learning models have a tendency to leverage spurious correlations that exist in the training set but may not hold true in general circumstances. For instance, a sentiment classif…
Classificationtext-classificationText ClassificationReward Models are Metrics in a Trench Coat
The emergence of reinforcement learning in post-training of large language models has sparked significant interest in reward models. Reward models assess the quality of sampled model outputs to generate training signals.…
Reinforcement LearningCorrect-N-Contrast: A Contrastive Approach for Improving Robustness to Spurious Correlations
Spurious correlations pose a major challenge for robust machine learning. Models trained with empirical risk minimization (ERM) may learn to rely on correlations between class labels and spurious attributes, leading to p…
AttributeContrastive Learning