paper-with-me

Papers

ExMap: Leveraging Explainability Heatmaps for Unsupervised Group Robustness to Spurious Correlations

2024-03-20 · CVPR 2024 1 · Rwiddhi Chakraborty, Adrian Sletten, Michael Kampffmeyer

Group robustness strategies aim to mitigate learned biases in deep learning models that arise from spurious correlations present in their training datasets. However, most existing methods rely on the access to the label distribution of the groups, which is time-consuming and expensive to obtain. As a result, unsupervised group robustness strategies are sought. Based on the insight that a trained model's classification strategies can be inferred accurately based on explainability heatmaps, we introduce ExMap, an unsupervised two stage mechanism designed to enhance group robustness in traditional classifiers. ExMap utilizes a clustering module to infer pseudo-labels based on a model's explainability heatmaps, which are then used during training in lieu of actual labels. Our empirical studies validate the efficacy of ExMap - We demonstrate that it bridges the performance gap with its supervised counterparts and outperforms existing partially supervised and unsupervised methods. Additionally, ExMap can be seamlessly integrated with existing group robustness learning strategies. Finally, we demonstrate its potential in tackling the emerging issue of multiple shortcut mitigation\footnote{Code available at \url{https://github.com/rwchakra/exmap}}.

📄 PDF Abstract BibTeX arXiv:2403.13870

Code (1)

rwchakra/exmap 공식 구현 pytorch

Similar Papers 제목 키워드 기반

FlexMap: Generalized HD Map Construction from Flexible Camera Configurations

2026-01-29 · Run Wang, Chaoyi Zhou, Amir Salarpour, Xi Liu 외 arxiv

High-definition (HD) maps provide essential semantic information of road structures for autonomous driving systems, yet current HD map construction methods require calibrated multi-camera setups and either implicit or ex…

Scene UnderstandingAutonomous DrivingSpatial Reasoning

Beyond Patches: Mining Interpretable Part-Prototypes for Explainable AI

2025-04-16 · Mahdi Alehdaghi, Rajarshi Bhattacharya, Pourya Shamsolmoali, Rafael M. O. Cruz 외

Deep learning has provided considerable advancements for multimedia systems, yet the interpretability of deep models remains a challenge. State-of-the-art post-hoc explainability methods, such as GradCAM, provide visual …

Unsupervised Part Discovery

End-to-End Shared Attention Estimation via Group Detection with Feedback Refinement

2026-04-02 · Chihiro Nakatani, Norimichi Ukita, Jean-Marc Odobez arxiv

This paper proposes an end-to-end shared attention estimation method via group detection. Most previous methods estimate shared attention (SA) without detecting the actual group of people focusing on it, or assume that t…

Quantifying Explainability of Saliency Methods in Deep Neural Networks with a Synthetic Dataset

2020-09-07 · Erico Tjoa, Cuntai Guan

Post-hoc analysis is a popular category in eXplainable artificial intelligence (XAI) study. In particular, methods that generate heatmaps have been used to explain the deep neural network (DNN), a black-box model. Heatma…

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)

On the Faithfulness of Vision Transformer Explanations

2024-04-01 · CVPR 2024 1 · Junyi Wu, Weitai Kang, Hao Tang, Yuan Hong 외

To interpret Vision Transformers, post-hoc explanations assign salience scores to input pixels, providing human-understandable heatmaps. However, whether these interpretations reflect true rationales behind the model's o…