paper-with-me

Papers

On Creating A Brain-To-Text Decoder

2025-01-10 · Zenon Lamprou, Yashar Moshfeghi

Brain decoding has emerged as a rapidly advancing and extensively utilized technique within neuroscience. This paper centers on the application of raw electroencephalogram (EEG) signals for decoding human brain activity, offering a more expedited and efficient methodology for enhancing our understanding of the human brain. The investigation specifically scrutinizes the efficacy of brain-computer interfaces (BCI) in deciphering neural signals associated with speech production, with particular emphasis on the impact of vocabulary size, electrode density, and training data on the framework's performance. The study reveals the competitive word error rates (WERs) achievable on the Librispeech benchmark through pre-training on unlabelled data for speech processing. Furthermore, the study evaluates the efficacy of voice recognition under configurations with limited labeled data, surpassing previous state-of-the-art techniques while utilizing significantly fewer labels. Additionally, the research provides a comprehensive analysis of error patterns in voice recognition and the influence of model size and unlabelled training data. It underscores the significance of factors such as vocabulary size and electrode density in enhancing BCI performance, advocating for an increase in microelectrodes and refinement of language models.

📄 PDF Abstract BibTeX arXiv:2501.06326

Code (0)

등록된 구현이 없습니다.

Tasks

Brain DecodingDecoderEEGElectroencephalogram (EEG)

Similar Papers 제목 키워드 기반

How Many Bytes Can You Take Out Of Brain-To-Text Decoding?

2024-05-22 · Richard Antonello, Nihita Sarma, Jerry Tang, Jiaru Song 외

Brain-computer interfaces have promising medical and scientific applications for aiding speech and studying the brain. In this work, we propose an information-based evaluation metric for brain-to-text decoders. Using thi…

Brain DecodingDecoder

A Deep Network for Joint Registration and Reconstruction of Images with Pathologies

2020-08-17 · Xu Han, Zhengyang Shen, Zhenlin Xu, Spyridon Bakas 외

Registration of images with pathologies is challenging due to tissue appearance changes and missing correspondences caused by the pathologies. Moreover, mass effects as observed for brain tumors may displace tissue, crea…

Image Registration

Modality-Agnostic fMRI Decoding of Vision and Language

2024-03-18 · Mitja Nikolaus, Milad Mozafari, Nicholas Asher, Leila Reddy 외

Previous studies have shown that it is possible to map brain activation data of subjects viewing images onto the feature representation space of not only vision models (modality-specific decoding) but also language model…

Decoder

Towards Brain-to-Text Generation: Neural Decoding with Pre-trained Encoder-Decoder Models

2021-09-24 · NeurIPS Workshop AI4Scien 2021 12 · Shuxian Zou, Shaonan Wang, Jiajun Zhang, Chengqing Zong

Decoding language from non-invasive brain signals is crucial in building widely applicable brain-computer interfaces (BCIs). However, most of the existing studies have focused on discriminating which one in two stimuli c…

DecoderText Generation

Phoneme- vs. Character-Level Targets and Selective State-Space Models for Intracortical Brain-to-Text

2026-07-29 · Lucas Zamora Vera, Jose A. Gonzalez-Lopez arxiv

State-of-the-art intracortical brain-to-text systems pair a neural-sequence phone decoder with an external language model. Two design axes remain underexplored: whether selective state-space models (Mamba) improve on rec…