paper-with-me

홈 › Papers

A unified information-theoretic model of EEG signatures of human language processing

2022-12-16 · Jiaxuan Li, Richard Futrell

We advance an information-theoretic model of human language processing in the brain, in which incoming linguistic input is processed at two levels, in terms of a heuristic interpretation and in terms of error correction. We propose that these two kinds of information processing have distinct electroencephalographic signatures, corresponding to the well-documented N400 and P600 components of language-related event-related potentials (ERPs). Formally, we show that the information content (surprisal) of a word in context can be decomposed into two quantities: (A) heuristic surprise, which signals processing difficulty of word given its inferred context, and corresponds with the N400 signal; and (B) discrepancy signal, which reflects divergence between the true context and the inferred context, and corresponds to the P600 signal. Both of these quantities can be estimated using modern NLP techniques. We validate our theory by successfully simulating ERP patterns elicited by a variety of linguistic manipulations in previously-reported experimental data from Ryskin et al. (2021). Our theory is in principle compatible with traditional cognitive theories assuming a `good-enough' heuristic interpretation stage, but with precise information-theoretic formulation.

📄 PDF Abstract BibTeX arXiv:2212.08205

Code (0)

등록된 구현이 없습니다.

Tasks

EEGElectroencephalogram (EEG)ERP

Similar Papers 제목 키워드 기반

Human Supervision as an Information Bottleneck: A Unified Theory of Error Floors in Human-Guided Learning

2026-02-26 · Alejandro Rodriguez Dominguez arxiv

Large language models are trained primarily on human-generated data and feedback, yet they exhibit persistent errors arising from annotation noise, subjective preferences, and the limited expressive bandwidth of natural …

Reinforcement LearningCausal Inference

Decomposition of surprisal: Unified computational model of ERP components in language processing

2024-09-10 · Jiaxuan Li, Richard Futrell

The functional interpretation of language-related ERP components has been a central debate in psycholinguistics for decades. We advance an information-theoretic model of human language processing in the brain in which in…

ERP

An information-theoretic model of shallow and deep language comprehension

2024-05-13 · Jiaxuan Li, Richard Futrell

A large body of work in psycholinguistics has focused on the idea that online language comprehension can be shallow or `good enough': given constraints on time or available computation, comprehenders may form interpretat…

EEGERPSentence

Repurposing Unified Topological Signatures for Graph Representation Learning

2026-09-15 · Sanyam Sanjay Jain, Anshika Krishnatray, Aditya Sharma, Vinti Agarwal arxiv

Message-passing Graph Neural Networks (GNNs) iteratively propagate and aggregate local neighborhood information followed by global readout to learn graph representations. However, their discriminative power is upper-boun…

Graph Representation LearningGraph Classification

Odoriko: A Shape-Aware Multimodal Diffusion Framework for Human Motion

2026-06-19 · Dongseok Shim, Julian Tanke, Kengo Uchida, Christian Simon 외 arxiv

Human motion generation has been widely studied across diverse input modalities, text, music, and video, and recent efforts have unified these into single multimodal frameworks. However, while morphological factors such …