Non-invasive Neural Decoding in Source Reconstructed Brain Space
Non-invasive brainwave decoding is usually done using Magneto/Electroencephalography (MEG/EEG) sensor measurements as inputs. This makes combining datasets and building models with inductive biases difficult as most datasets use different scanners and the sensor arrays have a nonintuitive spatial structure. In contrast, fMRI scans are acquired directly in brain space, a voxel grid with a typical structured input representation. By using established techniques to reconstruct the sensors' sources' neural activity it is possible to decode from voxels for MEG data as well. We show that this enables spatial inductive biases, spatial data augmentations, better interpretability, zero-shot generalisation between datasets, and data harmonisation.
Code (0)
등록된 구현이 없습니다.
Tasks
EEGSimilar Papers 제목 키워드 기반
Reverse the auditory processing pathway: Coarse-to-fine audio reconstruction from fMRI
Drawing inspiration from the hierarchical processing of the human auditory system, which transforms sound from low-level acoustic features to high-level semantic understanding, we introduce a novel coarse-to-fine audio r…
FADImproved Decoding of Attentional Selection in Multi-Talker Environments with Self-Supervised Learned Speech Representation
Auditory attention decoding (AAD) is a technique used to identify and amplify the talker that a listener is focused on in a noisy environment. This is done by comparing the listener's brainwaves to a representation of al…
One Brain, Omni Modalities: Towards Unified Non-Invasive Brain Decoding with Large Language Models
Deciphering brain function through non-invasive recordings requires synthesizing complementary high-frequency electromagnetic (EEG/MEG) and low-frequency metabolic (fMRI) signals. However, despite their shared neural ori…
Brain DecodingCNNATT: Deep EEG & fNIRS Real-Time Decoding of bimanual forces
Non-invasive cortical neural interfaces have only achieved modest performance in cortical decoding of limb movements and their forces, compared to invasive brain-computer interfaces (BCIs). While non-invasive methodologi…
DecoderEEGElectroencephalogram (EEG)A Pre-trained Framework for Multilingual Brain Decoding Using Non-invasive Recordings
Brain-computer interfaces (BCIs) with speech decoding from brain recordings have broad application potential in fields such as clinical rehabilitation and cognitive neuroscience. However, current decoding methods remain …
Brain DecodingFairness