paper-with-me

홈 › Papers

SETransformer: A Hybrid Attention-Based Architecture for Robust Human Activity Recognition

2025-05-25 · Yunbo Liu, Xukui Qin, Yifan Gao, Xiang Li, Chengwei Feng

Human Activity Recognition (HAR) using wearable sensor data has become a central task in mobile computing, healthcare, and human-computer interaction. Despite the success of traditional deep learning models such as CNNs and RNNs, they often struggle to capture long-range temporal dependencies and contextual relevance across multiple sensor channels. To address these limitations, we propose SETransformer, a hybrid deep neural architecture that combines Transformer-based temporal modeling with channel-wise squeeze-and-excitation (SE) attention and a learnable temporal attention pooling mechanism. The model takes raw triaxial accelerometer data as input and leverages global self-attention to capture activity-specific motion dynamics over extended time windows, while adaptively emphasizing informative sensor channels and critical time steps. We evaluate SETransformer on the WISDM dataset and demonstrate that it significantly outperforms conventional models including LSTM, GRU, BiLSTM, and CNN baselines. The proposed model achieves a validation accuracy of 84.68\% and a macro F1-score of 84.64\%, surpassing all baseline architectures by a notable margin. Our results show that SETransformer is a competitive and interpretable solution for real-world HAR tasks, with strong potential for deployment in mobile and ubiquitous sensing applications.

📄 PDF Abstract BibTeX arXiv:2505.19369

Code (0)

등록된 구현이 없습니다.

Tasks

Activity RecognitionHuman Activity Recognition

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Tanh Activation 설명 없음
BiLSTM A Bidirectional LSTM, or biLSTM, is a sequence processing model that consists of two LSTMs: one taking the input in a forward direction, and the other in a backwards…
Sigmoid Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Attention Pooling 설명 없음
GRU A Gated Recurrent Unit, or GRU, is a type of recurrent neural network. It is similar to an LSTM, but only has two gates - a reset…

Similar Papers 제목 키워드 기반

PhraseTransformer: An Incorporation of Local Context Information into Sequence-to-sequence Semantic Parsing

2022-11-29 · Applied Intelligence 2022 11 · Phuong Minh Nguyen, Tung Le, Huy Tien Nguyen, Vu Tran 외

Semantic parsing is a challenging task mapping a natural language utterance to machine-understandable information representation. Recently, approaches using neural machine translation (NMT) have achieved many promising r…

Machine TranslationNMTSemantic ParsingSentence+1

PhraseTransformer: Self-Attention using Local Context for Semantic Parsing

2021-01-01 · Phuong Minh Nguyen, Vu Tran, Minh Le Nguyen

Semantic parsing is a challenging task whose purpose is to convert a natural language utterance to machine-understandable information representation. Recently, solutions using Neural Machine Translation have achieved man…

Machine TranslationSemantic ParsingSentenceTranslation

BaseTransformers: Attention over base data-points for One Shot Learning

2022-10-05 · Mayug Maniparambil, Kevin McGuinness, Noel O'Connor

Few shot classification aims to learn to recognize novel categories using only limited samples per category. Most current few shot methods use a base dataset rich in labeled examples to train an encoder that is used for …

Few-Shot Image ClassificationOne-Shot Learning

Human Activity Recognition from Wearable Sensor Data Using Self-Attention

2020-03-17 · Saif Mahmud, M Tanjid Hasan Tonmoy, Kishor Kumar Bhaumik, A K M Mahbubur Rahman 외

Human Activity Recognition from body-worn sensor data poses an inherent challenge in capturing spatial and temporal dependencies of time-series signals. In this regard, the existing recurrent or convolutional or their hy…

Activity RecognitionHuman Activity RecognitionTime SeriesTime Series Analysis

ConViViT -- A Deep Neural Network Combining Convolutions and Factorized Self-Attention for Human Activity Recognition

2023-10-22 · Rachid Reda Dokkar, Faten Chaieb, Hassen Drira, Arezki Aberkane

The Transformer architecture has gained significant popularity in computer vision tasks due to its capacity to generalize and capture long-range dependencies. This characteristic makes it well-suited for generating spati…

Activity RecognitionHuman Activity Recognition