paper-with-me

홈 › Papers

Deep learning approaches for neural decoding: from CNNs to LSTMs and spikes to fMRI

2020-05-19 · Jesse A. Livezey, Joshua I. Glaser

Decoding behavior, perception, or cognitive state directly from neural signals has applications in brain-computer interface research as well as implications for systems neuroscience. In the last decade, deep learning has become the state-of-the-art method in many machine learning tasks ranging from speech recognition to image segmentation. The success of deep networks in other domains has led to a new wave of applications in neuroscience. In this article, we review deep learning approaches to neural decoding. We describe the architectures used for extracting useful features from neural recording modalities ranging from spikes to EEG. Furthermore, we explore how deep learning has been leveraged to predict common outputs including movement, speech, and vision, with a focus on how pretrained deep networks can be incorporated as priors for complex decoding targets like acoustic speech or images. Deep learning has been shown to be a useful tool for improving the accuracy and flexibility of neural decoding across a wide range of tasks, and we point out areas for future scientific development.

📄 PDF Abstract BibTeX arXiv:2005.09687

Code (0)

등록된 구현이 없습니다.

Tasks

Brain Computer InterfaceDeep LearningEEGElectroencephalogram (EEG)Image SegmentationSemantic Segmentationspeech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

Reconstruction of Natural Visual Scenes from Neural Spikes with Deep Neural Networks

2019-04-30 · Yichen Zhang, Shanshan Jia, Yajing Zheng, Zhaofei Yu 외

Neural coding is one of the central questions in systems neuroscience for understanding how the brain processes stimulus from the environment, moreover, it is also a cornerstone for designing algorithms of brain-machine …

Decoder

A Hybrid 3DCNN and 3DC-LSTM based model for 4D Spatio-temporal fMRI data: An ABIDE Autism Classification study

2020-02-14 · Ahmed El-Gazzar, Mirjam Quaak, Leonardo Cerliani, Peter Bloem 외

Functional Magnetic Resonance Imaging (fMRI) captures the temporal dynamics of neural activity as a function of spatial location in the brain. Thus, fMRI scans are represented as 4-Dimensional (3-space + 1-time) tensors.…

Deep Learning Inductive Biases for fMRI Time Series Classification during Resting-state and Movie-watching

2025-09-21 · Behdad Khodabandehloo, Reza Rajimehr arxiv

Deep learning has advanced fMRI analysis, yet it remains unclear which architectural inductive biases are most effective at capturing functional patterns in human brain activity. This issue is particularly important in s…

Time Series Classification

MindLLM: A Subject-Agnostic and Versatile Model for fMRI-to-Text Decoding

2025-02-18 · Weikang Qiu, Zheng Huang, Haoyu Hu, Aosong Feng 외

Decoding functional magnetic resonance imaging (fMRI) signals into text has been a key challenge in the neuroscience community, with the potential to advance brain-computer interfaces and uncover deeper insights into bra…

Decision Making

Performance of data-driven inner speech decoding with same-task EEG-fMRI data fusion and bimodal models

2023-06-19 · Holly Wilson, Scott Wellington, Foteini Simistira Liwicki, Vibha Gupta 외

Decoding inner speech from the brain signal via hybridisation of fMRI and EEG data is explored to investigate the performance benefits over unimodal models. Two different bimodal fusion approaches are examined: concatena…

EEGFeature Engineering