paper-with-me

홈 › Papers

The Multiple Dimensions of Spuriousness in Machine Learning

2024-11-07 · Samuel J. Bell, Skyler Wang

Learning correlations from data forms the foundation of today's machine learning (ML) and artificial intelligence (AI) research. While such an approach enables the automatic discovery of patterned relationships within big data corpora, it is susceptible to failure modes when unintended correlations are captured. This vulnerability has expanded interest in interrogating spuriousness, often critiqued as an impediment to model performance, fairness, and robustness. In this article, we trace deviations from the conventional definition of statistical spuriousness-which denotes a non-causal observation arising from either coincidence or confounding variables-to articulate how ML researchers make sense of spuriousness in practice. Drawing on a broad survey of ML literature, we conceptualize the "multiple dimensions of spuriousness," encompassing: relevance ("Models should only use correlations that are relevant to the task."), generalizability ("Models should only use correlations that generalize to unseen data"), human-likeness ("Models should only use correlations that a human would use to perform the same task"), and harmfulness ("Models should only use correlations that are not harmful"). These dimensions demonstrate that ML spuriousness goes beyond the causal/non-causal dichotomy and that the disparate interpretative paths researchers choose could meaningfully influence the trajectory of ML development. By underscoring how a fundamental problem in ML is contingently negotiated in research contexts, we contribute to ongoing debates about responsible practices in AI development.

📄 PDF Abstract BibTeX arXiv:2411.04696

Code (0)

등록된 구현이 없습니다.

Tasks

Fairness

Similar Papers 제목 키워드 기반

Quantifying Spuriousness of Biased Datasets Using Partial Information Decomposition

2024-06-29 · Barproda Halder, Faisal Hamman, Pasan Dissanayake, Qiuyi Zhang 외

Spurious patterns refer to a mathematical association between two or more variables in a dataset that are not causally related. However, this notion of spuriousness, which is usually introduced due to sampling biases in …

Spuriousness-Aware Meta-Learning for Learning Robust Classifiers

2024-06-15 · Guangtao Zheng, Wenqian Ye, Aidong Zhang

Spurious correlations are brittle associations between certain attributes of inputs and target variables, such as the correlation between an image background and an object class. Deep image classifiers often leverage the…

AttributeLanguage ModellingMeta-Learning

Towards Robust Classification Model by Counterfactual and Invariant Data Generation

2021-06-02 · CVPR 2021 1 · Chun-Hao Chang, George Alexandru Adam, Anna Goldenberg

Despite the success of machine learning applications in science, industry, and society in general, many approaches are known to be non-robust, often relying on spurious correlations to make predictions. Spuriousness occu…

Classificationcounterfactualimage-classificationImage Classification+2

Out-of-distribution Prediction with Invariant Risk Minimization: The Limitation and An Effective Fix

2021-01-16 · Ruocheng Guo, Pengchuan Zhang, Hao liu, Emre Kiciman

This work considers the out-of-distribution (OOD) prediction problem where (1)~the training data are from multiple domains and (2)~the test domain is unseen in the training. DNNs fail in OOD prediction because they are p…

Towards Trustworthy Explanation: On Causal Rationalization

2023-06-25 · Wenbo Zhang, Tong Wu, Yunlong Wang, Yong Cai 외

With recent advances in natural language processing, rationalization becomes an essential self-explaining diagram to disentangle the black box by selecting a subset of input texts to account for the major variation in pr…

Causal Inference