paper-with-me

홈 › Papers

Fine-grained Analysis of Brain-LLM Alignment through Input Attribution

2025-10-14 · Michela Proietti, Roberto Capobianco, Mariya Toneva arxiv

Understanding the alignment between large language models (LLMs) and human brain activity can reveal computational principles underlying language processing. We introduce a fine-grained input attribution method to identify the specific words most important for brain-LLM alignment, and leverage it to study a contentious research question about brain-LLM alignment: the relationship between brain alignment (BA) and next-word prediction (NWP). Our findings reveal that BA and NWP rely on largely distinct word subsets: NWP exhibits recency and primacy biases with a focus on syntax, while BA prioritizes semantic and discourse-level information with a more targeted recency effect. This work advances our understanding of how LLMs relate to human language processing and highlights differences in feature reliance between BA and NWP. Beyond this study, our attribution method can be broadly applied to explore the cognitive relevance of model predictions in diverse language processing tasks.

📄 PDF Abstract BibTeX arXiv:2510.12355

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Enhancing Zero-Shot Brain Tumor Subtype Classification via Fine-Grained Patch-Text Alignment

2025-08-03 · Lubin Gan, Jing Zhang, Linhao Qu, Yijun Wang 외 arxiv

The fine-grained classification of brain tumor subtypes from histopathological whole slide images is highly challenging due to subtle morphological variations and the scarcity of annotated data. Although vision-language …

MindAligner: Explicit Brain Functional Alignment for Cross-Subject Visual Decoding from Limited fMRI Data

2025-02-07 · Yuqin Dai, Zhouheng Yao, Chunfeng Song, Qihao Zheng 외

Brain decoding aims to reconstruct visual perception of human subject from fMRI signals, which is crucial for understanding brain's perception mechanisms. Existing methods are confined to the single-subject paradigm due …

Brain Decoding

Achieving Fine-grained Cross-modal Understanding through Brain-inspired Hierarchical Representation Learning

2026-01-04 · Weihang You, Hanqi Jiang, Yi Pan, Junhao Chen 외 arxiv

Understanding neural responses to visual stimuli remains challenging due to the inherent complexity of brain representations and the modality gap between neural data and visual inputs. Existing methods, mainly based on r…

Representation LearningCross-Modal RetrievalContrastive LearningVideo Alignment

BrainSCUBA: Fine-Grained Natural Language Captions of Visual Cortex Selectivity

2023-10-06 · Andrew F. Luo, Margaret M. Henderson, Michael J. Tarr, Leila Wehbe

Understanding the functional organization of higher visual cortex is a central focus in neuroscience. Past studies have primarily mapped the visual and semantic selectivity of neural populations using hand-selected stimu…

Image GenerationLanguage ModelingLanguage ModellingLarge Language Model+1

MindAdapter: Few-Shot Parameter-Efficient Residual Calibration of Cross-Subject Brain-to-Visual Decoding Models

2026-05-23 · Jiaxiang Liu, Jiawei Du, Xupeng Chen, Guoqi Li 외 arxiv

Cross-subject brain-to-visual decoding remains a core challenge in brain-computer interfaces due to severe inter-individual variability that induces systematic subject-specific functional misalignment. To address this is…