paper-with-me

Papers

Decoding silent reading from non-invasive EEG

2026-08-20 · Ingo Marquardt, Anthilia Alchanat, Priyanka Jain arxiv

Non-invasive decoding of inner speech faces a fundamental data problem: a corpus pairing brain activity with a person's spontaneous inner monologue cannot be collected, and the available proxy paradigms (cued repetitive and retrospectively reported generative inner speech) are slow to acquire, poorly time-locked, and subject compliance is unverifiable. We therefore treat silent reading as a scalable proxy task and ask how much lexical and semantic information a contrastive decoder can extract from it. We report an open-vocabulary analysis of approximately 240,000 word presentations recorded from a single densely-sampled participant across 393 runs (ca. 49 h) of 19-channel dry-electrode EEG. Words from continuous narrative text were presented in rapid serial visual presentation, with typography randomised on every trial to partially decorrelate word identity from low-level visual form. A convolutional EEG encoder, optionally followed by a causal transformer, was trained with a CLIP-style contrastive objective to align short EEG windows with hidden-state embeddings of the presented word taken from a large language model. Decoding, evaluated as word-grouped top-10 retrieval against permutation baselines, was reliably above chance, extended to mid-frequency and rare words, and scaled log-linearly with training-data volume with no sign of saturation. Removing occipital and posterior-temporal electrodes reduced the word-level gain by roughly one third but left context tracking unchanged. Control analyses separate word-level decoding from narrative context tracking and from a non-neural positional prior introduced by the transformer's positional embedding. These results establish that open-vocabulary word-level information is recoverable from EEG during silent reading, and that decoding is data-limited rather than saturated.

📄 PDF Abstract BibTeX arXiv:2608.20186

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Transfer Learning from ImageNet for MEG-Based Decoding of Imagined Speech

2026-01-22 · Soufiane Jhilal, Stéphanie Martin, Anne-Lise Giraud arxiv

Non-invasive decoding of imagined speech remains challenging due to weak, distributed signals and limited labeled data. Our paper introduces an image-based approach that transforms magnetoencephalography (MEG) signals in…

Transfer Learning

Cross-Modal Masking for Robust Silent Speech Synthesis Using sEMG and Lipreading

2026-06-08 · Eder del Blanco, David Gimeno-Gómez, Eva Navas, Carlos-D. Martínez-Hinarejos 외 arxiv

Speech restoration through silent speech interfaces (SSIs) has emerged as a promising assistive technology for individuals with impaired or absent laryngeal voice production. Among non-invasive SSI modalities, surface el…

Speech Synthesis

Decoding individual words from non-invasive brain recordings across 723 participants

2024-12-11 · Stéphane d'Ascoli, Corentin Bel, Jérémy Rapin, Hubert Banville 외

Deep learning has recently enabled the decoding of language from the neural activity of a few participants with electrodes implanted inside their brain. However, reliably decoding words from non-invasive recordings remai…

EEG

Decoding EEG Speech Perception with Transformers and VAE-based Data Augmentation

2025-01-08 · Terrance Yu-Hao Chen, Yulin Chen, Pontus Soederhaell, Sadrishya Agrawal 외

Decoding speech from non-invasive brain signals, such as electroencephalography (EEG), has the potential to advance brain-computer interfaces (BCIs), with applications in silent communication and assistive technologies f…

Data AugmentationEEGElectromyography (EMG)

Geometry of orofacial neuromuscular signals: speech articulation decoding using surface electromyography

2024-11-04 · Harshavardhana T. Gowda, Zachary D. McNaughton, Lee M. Miller

Each year, millions of individuals lose the ability to speak intelligibly due to causes such as neuromuscular disease, stroke, trauma, and head/neck cancer surgery (e.g. laryngectomy) or treatment (e.g. radiotherapy toxi…