paper-with-me

Papers

Decoding Human Attentive States from Spatial-temporal EEG Patches Using Transformers

2025-02-06 · Yi Ding, Joon Hei Lee, Shuailei Zhang, Tianze Luo, Cuntai Guan

Learning the spatial topology of electroencephalogram (EEG) channels and their temporal dynamics is crucial for decoding attention states. This paper introduces EEG-PatchFormer, a transformer-based deep learning framework designed specifically for EEG attention classification in Brain-Computer Interface (BCI) applications. By integrating a Temporal CNN for frequency-based EEG feature extraction, a pointwise CNN for feature enhancement, and Spatial and Temporal Patching modules for organizing features into spatial-temporal patches, EEG-PatchFormer jointly learns spatial-temporal information from EEG data. Leveraging the global learning capabilities of the self-attention mechanism, it captures essential features across brain regions over time, thereby enhancing EEG data decoding performance. Demonstrating superior performance, EEG-PatchFormer surpasses existing benchmarks in accuracy, area under the ROC curve (AUC), and macro-F1 score on a public cognitive attention dataset. The code can be found via: https://github.com/yi-ding-cs/EEG-PatchFormer .

📄 PDF Abstract BibTeX arXiv:2502.03736

Code (1)

yi-ding-cs/eeg-patchformer 공식 구현 pytorch

Tasks

Brain Computer InterfaceEEGElectroencephalogram (EEG)

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Patching Activation patching studies the model's computation by altering its latent representations, the token embeddings in transformer-based language models, during the inference process

Similar Papers 제목 키워드 기반

Explainable fMRI-based Brain Decoding via Spatial Temporal-pyramid Graph Convolutional Network

2022-10-08 · Ziyuan Ye, Youzhi Qu, Zhichao Liang, Mo Wang 외

Brain decoding, aiming to identify the brain states using neural activity, is important for cognitive neuroscience and neural engineering. However, existing machine learning methods for fMRI-based brain decoding either s…

Brain Decoding

STDec: Spatio-Temporal Stability Guided Decoding for dLLMs

2026-04-07 · Yuzhe Chen, Jiale Cao, Xuyang Liu, Jin Xie 외 arxiv

Diffusion Large Language Models (dLLMs) have achieved rapid progress, viewed as a promising alternative to the autoregressive paradigm. However, most dLLM decoders still adopt a global confidence threshold, and do not ex…

Integrating Temporal and Spatial Attentions for VATEX Video Captioning Challenge 2019

2019-10-15 · Shizhe Chen, Yida Zhao, Yuqing Song, Qin Jin 외

This notebook paper presents our model in the VATEX video captioning challenge. In order to capture multi-level aspects in the video, we propose to integrate both temporal and spatial attentions for video captioning. The…

Video Captioning

DuA: Dual Attentive Transformer in Long-Term Continuous EEG Emotion Analysis

2024-07-30 · Yue Pan, Qile Liu, Qing Liu, Li Zhang 외

Affective brain-computer interfaces (aBCIs) are increasingly recognized for their potential in monitoring and interpreting emotional states through electroencephalography (EEG) signals. Current EEG-based emotion recognit…

EEGEmotion RecognitionTransfer Learning

Learning Locally Interacting Discrete Dynamical Systems: Towards Data-Efficient and Scalable Prediction

2024-04-09 · Beomseok Kang, Harshit Kumar, Minah Lee, Biswadeep Chakraborty 외

Locally interacting dynamical systems, such as epidemic spread, rumor propagation through crowd, and forest fire, exhibit complex global dynamics originated from local, relatively simple, and often stochastic interaction…