paper-with-me

홈 › Papers

Beyond Accuracy: Robustness, Interpretability and Expressiveness of EEG Foundation Models

2026-05-17 · Urban Širca, Maryam Alimardani, Stefanos Zafeiriou, Konstantinos Barmpas arxiv

EEG foundation models (EEG-FMs) have been evaluated predominantly on clean, in-distribution accuracy, leaving their robustness, interpretability and representational quality largely unexamined. This study addresses these gaps by benchmarking six EEG-FMs against a baseline deep learning model across eight datasets. Beyond clean accuracy, we conduct three layers of analysis: (i) Robustness: we apply test-time perturbations including additive noise, random and region-based channel dropout and region-specific noise injection. Our analyses show that no single model dominates all failure modes. The most noise-robust model is among the most fragile under channel dropout and much of the dropout fragility disappears when channels are removed rather than zero-padded. (ii) Interpretability: we present the first application of Attention-Aware Layer-Wise Relevance Propagation (AttnLRP) to EEG-FMs and show that models broadly concentrate relevance on task-appropriate brain regions consistent with known neurophysiology. However, attribution maps remain spatially stable under perturbation while predictions degrade, suggesting that the models attend to the correct brain regions but decode corrupted content. (iii) Expressiveness: With block-wise probing we show that late blocks are repurposed during fine-tuning, while early blocks already hold task-related information. Furthermore, we demonstrate that the poor head-only performance previously attributed to low-quality pre-trained representations is largely explained by pooling and that EEG-FMs possess sufficient representational capacity when their token-level embeddings are preserved. Together, these findings provide the first systematic assessment of robustness, interpretability and expressiveness for EEG-FMs and highlight critical considerations for their development.

📄 PDF Abstract BibTeX arXiv:2605.17562

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Beyond Interpretability: The Gains of Feature Monosemanticity on Model Robustness

2024-10-27 · Qi Zhang, Yifei Wang, Jingyi Cui, Xiang Pan 외

Deep learning models often suffer from a lack of interpretability due to polysemanticity, where individual neurons are activated by multiple unrelated semantics, resulting in unclear attributions of model behavior. Recen…

Domain GeneralizationFew-Shot Learning

Causality Is Key to Understand and Balance Multiple Goals in Trustworthy ML and Foundation Models

2025-02-28 · Ruta Binkyte, Ivaxi Sheth, Zhijing Jin, Mohammad Havaei 외

Ensuring trustworthiness in machine learning (ML) systems is crucial as they become increasingly embedded in high-stakes domains. This paper advocates for integrating causal methods into machine learning to navigate the …

FairnessNavigate

Object Centric Concept Bottlenecks

2025-05-30 · David Steinmann, Wolfgang Stammer, Antonia Wüst, Kristian Kersting

Developing high-performing, yet interpretable models remains a critical challenge in modern AI. Concept-based models (CBMs) attempt to address this by extracting human-understandable concepts from a global encoding (e.g.…

Decision MakingObject

Learning Biomolecular Motion: The Physics-Informed Machine Learning Paradigm

2025-11-10 · Aaryesh Deshpande arxiv

The convergence of statistical learning and molecular physics is transforming our approach to modeling biomolecular systems. Physics-informed machine learning (PIML) offers a systematic framework that integrates data-dri…

Towards Interpretable Ensemble Learning for Image-based Malware Detection

2021-01-13 · Yuzhou Lin, Xiaolin Chang

Deep learning (DL) models for image-based malware detection have exhibited their capability in producing high prediction accuracy. But model interpretability is posing challenges to their widespread application in securi…

Ensemble LearningMalware Detection