Spurious Correlations in Concept Drift: Can Explanatory Interaction Help?
Long-running machine learning models face the issue of concept drift (CD), whereby the data distribution changes over time, compromising prediction performance. Updating the model requires detecting drift by monitoring the data and/or the model for unexpected changes. We show that, however, spurious correlations (SCs) can spoil the statistics tracked by detection algorithms. Motivated by this, we introduce ebc-exstream, a novel detector that leverages model explanations to identify potential SCs and human feedback to correct for them. It leverages an entropy-based heuristic to reduce the amount of necessary feedback, cutting annotation costs. Our preliminary experiments on artificially confounded data highlight the promise of ebc-exstream for reducing the impact of SCs on detection.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Constructing Concept-based Models to Mitigate Spurious Correlations with Minimal Human Effort
Enhancing model interpretability can address spurious correlations by revealing how models draw their predictions. Concept Bottleneck Models (CBMs) can provide a principled way of disclosing and guiding model behaviors t…
Unsupervised Concept Discovery Mitigates Spurious Correlations
Models prone to spurious correlations in training data often produce brittle predictions and introduce unintended biases. Addressing this challenge typically involves methods relying on prior knowledge and group annotati…
Representation LearningExplore Spurious Correlations at the Concept Level in Language Models for Text Classification
Language models (LMs) have achieved notable success in numerous NLP tasks, employing both fine-tuning and in-context learning (ICL) methods. While language models demonstrate exceptional performance, they face robustness…
counterfactualIn-Context Learningtext-classificationText ClassificationLabel-Efficient Group Robustness via Out-of-Distribution Concept Curation
Deep neural networks are prone to capture correlations between spurious attributes and class labels leading to low accuracy on some combinations of class labels and spurious attribute values. When a spurious attribut…
Attributeimage-classificationImage ClassificationCombating Concept Drift with Explanatory Detection and Adaptation for Android Malware Classification
Machine learning-based Android malware classifiers achieve high accuracy in stationary environments but struggle with concept drift. The rapid evolution of malware, especially with new families, can depress classificatio…
Drift DetectionMalware Classification