paper-with-me

홈 › Papers

The Predictive Brain: Neural Correlates of Word Expectancy Align with Large Language Model Prediction Probabilities

2025-06-10 · Nikola Kölbl, Konstantin Tziridis, Andreas Maier, Thomas Kinfe, Ricardo Chavarriaga, Achim Schilling, Patrick Krauss

Predictive coding theory suggests that the brain continuously anticipates upcoming words to optimize language processing, but the neural mechanisms remain unclear, particularly in naturalistic speech. Here, we simultaneously recorded EEG and MEG data from 29 participants while they listened to an audio book and assigned predictability scores to nouns using the BERT language model. Our results show that higher predictability is associated with reduced neural responses during word recognition, as reflected in lower N400 amplitudes, and with increased anticipatory activity before word onset. EEG data revealed increased pre-activation in left fronto-temporal regions, while MEG showed a tendency for greater sensorimotor engagement in response to low-predictability words, suggesting a possible motor-related component to linguistic anticipation. These findings provide new evidence that the brain dynamically integrates top-down predictions with bottom-up sensory input to facilitate language comprehension. To our knowledge, this is the first study to demonstrate these effects using naturalistic speech stimuli, bridging computational language models with neurophysiological data. Our findings provide novel insights for cognitive computational neuroscience, advancing the understanding of predictive processing in language and inspiring the development of neuroscience-inspired AI. Future research should explore the role of prediction and sensory precision in shaping neural responses and further refine models of language processing.

📄 PDF Abstract BibTeX arXiv:2506.08511

Code (0)

등록된 구현이 없습니다.

Tasks

EEGLanguage ModelingLanguage ModellingLarge Language Model

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

Relating cognition to both brain structure and function: A systematic review of methods

2022-02-04 · Marta Czime Litwińczuk, Nelson Trujillo-Barreto, Nils Muhlert, Lauren Cloutman 외

Cognitive neuroscience explores the mechanisms of cognition by studying its structural and functional brain correlates. Here, we report the first systematic review that assesses how information from structural and functi…

Signatures of prediction during natural listening in MEG data?

2024-12-27 · Sahel Azizpour, Britta U. Westner, Jakub Szewczyk, Umut Güçlü 외

The brain uses contextual information and prior knowledge to anticipate upcoming content during language comprehension. Recent research has shown predictive signals can be revealed in pre-onset ECoG activity during natur…

PredictionWord Embeddings

Verifying the HALE measures of the Global Burden of Disease Study: Quantitative Methods Proposed

2015-10-26

To verify the Global Burden of Disease Study and the provided healthy life expectancy (HALE) estimates from the World Health Organization (WHO) we propose a very simple model based on the mortality {\mu}x of a population…

Measuring Meaning Composition in the Human Brain with Composition Scores from Large Language Models

2024-03-07 · Changjiang Gao, Jixing Li, Jiajun Chen, ShuJian Huang

The process of meaning composition, wherein smaller units like morphemes or words combine to form the meaning of phrases and sentences, is essential for human sentence comprehension. Despite extensive neurolinguistic res…

Sentence

Free Word Order in Sanskrit and Well-nestedness

2020-12-01 · ICON 2020 12 · Sanal Vikram, Amba Kulkarni

The common wisdom about Sanskrit is that it is free word order language. This word order poses challenges such as handling non-projectivity in parsing. The earlier works on the word order of Sanskrit have shown that ther…