Bias Challenges in Counterfactual Data Augmentation
Deep learning models tend not to be out-of-distribution robust primarily due to their reliance on spurious features to solve the task. Counterfactual data augmentations provide a general way of (approximately) achieving representations that are counterfactual-invariant to spurious features, a requirement for out-of-distribution (OOD) robustness. In this work, we show that counterfactual data augmentations may not achieve the desired counterfactual-invariance if the augmentation is performed by a context-guessing machine, an abstract machine that guesses the most-likely context of a given input. We theoretically analyze the invariance imposed by such counterfactual data augmentations and describe an exemplar NLP task where counterfactual data augmentation by a context-guessing machine does not lead to robust OOD classifiers.
Code (0)
등록된 구현이 없습니다.
Tasks
counterfactualData AugmentationSimilar Papers 제목 키워드 기반
Guided Diffusion-based Counterfactual Augmentation for Robust Session-based Recommendation
Session-based recommendation (SR) models aim to recommend top-K items to a user, based on the user's behaviour during the current session. Several SR models are proposed in the literature, however,concerns have been rais…
counterfactualData AugmentationSession-Based RecommendationsCounterfactual Augmentation for Multimodal Learning Under Presentation Bias
In real-world machine learning systems, labels are often derived from user behaviors that the system wishes to encourage. Over time, new models must be trained as new training examples and features become available. Howe…
counterfactualOn Counterfactual Data Augmentation Under Confounding
Counterfactual data augmentation has recently emerged as a method to mitigate confounding biases in the training data. These biases, such as spurious correlations, arise due to various observed and unobserved confounding…
counterfactualData AugmentationCoBA: Counterbias Text Augmentation for Mitigating Various Spurious Correlations via Semantic Triples
Deep learning models often learn and exploit spurious correlations in training data, using these non-target features to inform their predictions. Such reliance leads to performance degradation and poor generalization on …
Data AugmentationModel-based Counterfactual Generator for Gender Bias Mitigation
Counterfactual Data Augmentation (CDA) has been one of the preferred techniques for mitigating gender bias in natural language models. CDA techniques have mostly employed word substitution based on dictionaries. Although…
counterfactualData Augmentationmodel