paper-with-me

Papers

ESTformer: Transformer Utilizing Spatiotemporal Dependencies for Electroencaphalogram Super-resolution

2023-12-03 · Dongdong Li, Zhongliang Zeng, Zhe Wang, Hai Yang

Towards practical applications of Electroencephalography (EEG), lightweight acquisition devices garner significant attention. However, EEG channel selection methods are commonly data-sensitive and cannot establish a unified sound paradigm for EEG acquisition devices. Through reverse conceptualisation, we formulated EEG applications in an EEG super-resolution (SR) manner, but suffered from high computation costs, extra interpolation bias, and few insights into spatiotemporal dependency modelling. To this end, we propose ESTformer, an EEG SR framework that utilises spatiotemporal dependencies based on the transformer. ESTformer applies positional encoding methods and a multihead self-attention mechanism to the space and time dimensions, which can learn spatial structural correlations and temporal functional variations. ESTformer, with the fixed mask strategy, adopts a mask token to upsample low-resolution (LR) EEG data in the case of disturbance from mathematical interpolation methods. On this basis, we designed various transformer blocks to construct a spatial interpolation module (SIM) and a temporal reconstruction module (TRM). Finally, ESTformer cascades the SIM and TRM to capture and model the spatiotemporal dependencies for EEG SR with fidelity. Extensive experimental results on two EEG datasets show the effectiveness of ESTformer against previous state-of-the-art methods, demonstrating the versatility of the Transformer for EEG SR tasks. The superiority of the SR data was verified in an EEG-based person identification and emotion recognition task, achieving a 2% to 38% improvement compared with the LR data at different sampling scales.

📄 PDF Abstract BibTeX arXiv:2312.10052

Code (0)

등록된 구현이 없습니다.

Tasks

channel selectionEEGEmotion RecognitionPerson IdentificationSpatial InterpolationSuper-Resolution

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Position-Wise Feed-Forward Layer 설명 없음
Focus 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Binary Event-Driven Spiking Transformer

2025-01-10 · Honglin Cao, Zijian Zhou, Wenjie Wei, Ammar Belatreche 외

Transformer-based Spiking Neural Networks (SNNs) introduce a novel event-driven self-attention paradigm that combines the high performance of Transformers with the energy efficiency of SNNs. However, the larger model siz…

Binarization

GestFormer: Multiscale Wavelet Pooling Transformer Network for Dynamic Hand Gesture Recognition

2024-05-18 · Mallika Garg, Debashis Ghosh, Pyari Mohan Pradhan

Transformer model have achieved state-of-the-art results in many applications like NLP, classification, etc. But their exploration in gesture recognition task is still limited. So, we propose a novel GestFormer architect…

Gesture RecognitionHand Gesture RecognitionHand-Gesture RecognitionOptical Flow Estimation

A Semantic and Motion-Aware Spatiotemporal Transformer Network for Action Detection

2024-05-13 · Matthew Korban, Peter Youngs, Scott T. Acton

This paper presents a novel spatiotemporal transformer network that introduces several original components to detect actions in untrimmed videos. First, the multi-feature selective semantic attention model calculates the…

Action Detection

Exploring Reliable Spatiotemporal Dependencies for Efficient Visual Tracking

2026-01-14 · Junze Shi, Yang Yu, Jian Shi, Haibo Luo arxiv

Recent advances in transformer-based lightweight object tracking have established new standards across benchmarks, leveraging the global receptive field and powerful feature extraction capabilities of attention mechanism…

Object TrackingVisual Tracking

Pest Manager: A Systematic Framework for Precise Pest Counting and Identification in Invisible Grain Pile Storage Environment

2024-09-03 · Chuanyang Ma, Jiangtao Li, Xingqun Qi, Muyi Sun 외

Pest infestations pose a significant risk to both the quality and quantity of stored grain, resulting in substantial economic losses. Accurate and timely pest monitoring is essential, but traditional methods are time-con…