paper-with-me

홈 › Papers

Neuro2Semantic: A Transfer Learning Framework for Semantic Reconstruction of Continuous Language from Human Intracranial EEG

2025-05-31 · Siavash Shams, Richard Antonello, Gavin Mischler, Stephan Bickel, Ashesh Mehta, Nima Mesgarani

Decoding continuous language from neural signals remains a significant challenge in the intersection of neuroscience and artificial intelligence. We introduce Neuro2Semantic, a novel framework that reconstructs the semantic content of perceived speech from intracranial EEG (iEEG) recordings. Our approach consists of two phases: first, an LSTM-based adapter aligns neural signals with pre-trained text embeddings; second, a corrector module generates continuous, natural text directly from these aligned embeddings. This flexible method overcomes the limitations of previous decoding approaches and enables unconstrained text generation. Neuro2Semantic achieves strong performance with as little as 30 minutes of neural data, outperforming a recent state-of-the-art method in low-data settings. These results highlight the potential for practical applications in brain-computer interfaces and neural decoding technologies.

📄 PDF Abstract BibTeX arXiv:2506.00381

Code (1)

SiavashShams/neuro2semantic 공식 구현 pytorch

Tasks

EEGText GenerationTransfer Learning

Methods 이 논문이 사용한 방법론

Adapter 설명 없음

Similar Papers 제목 키워드 기반

Bridging Brain and Semantics: A Hierarchical Framework for Semantically Enhanced fMRI-to-Video Reconstruction

2026-05-14 · Yujie Wei, Chenglong Ma, Jianxiong Gao, Chenhui Wang 외 arxiv

Reconstructing dynamic visual experiences as videos from functional magnetic resonance imaging (fMRI) is pivotal for advancing the understanding of neural processes. However, current fMRI-to-video reconstruction methods …

Video Reconstruction

Boosting HDR Image Reconstruction via Semantic Knowledge Transfer

2025-03-19 · Qingsen Yan, Tao Hu, Genggeng Chen, Wei Dong 외

Recovering High Dynamic Range (HDR) images from multiple Low Dynamic Range (LDR) images becomes challenging when the LDR images exhibit noticeable degradation and missing content. Leveraging scene-specific semantic prior…

HDR ReconstructionImage ReconstructionTransfer Learning

NeuroClips: Towards High-fidelity and Smooth fMRI-to-Video Reconstruction

2024-10-25 · Zixuan Gong, Guangyin Bao, Qi Zhang, Zhongwei Wan 외

Reconstruction of static visual stimuli from non-invasion brain activity fMRI achieves great success, owning to advanced deep learning models such as CLIP and Stable Diffusion. However, the research on fMRI-to-video reco…

SSIMVideo Reconstruction

Assembling the Mind's Mosaic: Towards EEG Semantic Intent Decoding

2026-01-28 · Jiahe Li, Junru Chen, Fanqi Shen, Jialan Yang 외 arxiv

Enabling natural communication through brain-computer interfaces (BCIs) remains one of the most profound challenges in neuroscience and neurotechnology. While existing frameworks offer partial solutions, they are constra…

Decoder Network Over Lightweight Reconstructed Feature for Fast Semantic Style Transfer

2017-10-01 · ICCV 2017 10 · Ming Lu, Hao Zhao, Anbang Yao, Feng Xu 외

Recently, the community of style transfer is trying to incorporate semantic information into traditional system. This practice achieves better perceptual results by transferring the style between semantically-correspondi…

DecoderStyle Transfer