paper-with-me

홈 › Papers

Feature Fusion for Human Activity Recognition using Parameter-Optimized Multi-Stage Graph Convolutional Network and Transformer Models

2024-06-24 · Mohammad Belal, Taimur Hassan, Abdelfatah Ahmed, Ahmad Aljarah, Nael Alsheikh, Irfan Hussain

Human activity recognition (HAR) is a crucial area of research that involves understanding human movements using computer and machine vision technology. Deep learning has emerged as a powerful tool for this task, with models such as Convolutional Neural Networks (CNNs) and Transformers being employed to capture various aspects of human motion. One of the key contributions of this work is the demonstration of the effectiveness of feature fusion in improving HAR accuracy by capturing spatial and temporal features, which has important implications for the development of more accurate and robust activity recognition systems. The study uses sensory data from HuGaDB, PKU-MMD, LARa, and TUG datasets. Two model, the PO-MS-GCN and a Transformer were trained and evaluated, with PO-MS-GCN outperforming state-of-the-art models. HuGaDB and TUG achieved high accuracies and f1-scores, while LARa and PKU-MMD had lower scores. Feature fusion improved results across datasets.

📄 PDF Abstract BibTeX arXiv:2406.16638

Code (0)

등록된 구현이 없습니다.

Tasks

Activity RecognitionHuman Activity Recognition

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Position-Wise Feed-Forward Layer 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Adam 설명 없음

Similar Papers 제목 키워드 기반

EmbraceNet for Activity: A Deep Multimodal Fusion Architecture for Activity Recognition

2020-04-29 · Jun-Ho Choi, Jong-Seok Lee

Human activity recognition using multiple sensors is a challenging but promising task in recent decades. In this paper, we propose a deep multimodal fusion model for activity recognition based on the recently proposed fe…

Activity RecognitionHuman Activity Recognition

Integrating Features for Recognizing Human Activities through Optimized Parameters in Graph Convolutional Networks and Transformer Architectures

2024-08-29 · Mohammad Belal, Taimur Hassan, Abdelfatah Hassan, Nael Alsheikh 외

Human activity recognition is a major field of study that employs computer vision, machine vision, and deep learning techniques to categorize human actions. The field of deep learning has made significant progress, with …

Activity RecognitionDeep LearningHuman Activity RecognitionHuman Dynamics

Unsupervised Statistical Feature-Guided Diffusion Model for Sensor-based Human Activity Recognition

2023-05-30 · Si Zuo, Vitor Fortes Rey, Sungho Suh, Stephan Sigg 외

Human activity recognition (HAR) from on-body sensors is a core functionality in many AI applications: from personal health, through sports and wellness to Industry 4.0. A key problem holding up progress in wearable sens…

Activity RecognitionGenerative Adversarial NetworkHuman Activity RecognitionTime Series

Distilled Mid-Fusion Transformer Networks for Multi-Modal Human Activity Recognition

2023-05-05 · Jingcheng Li, Lina Yao, Binghao Li, Claude Sammut

Human Activity Recognition is an important task in many human-computer collaborative scenarios, whilst having various practical applications. Although uni-modal approaches have been extensively studied, they suffer from …

Activity RecognitionFeature EngineeringHuman Activity RecognitionKnowledge Distillation

Structure Optimization for Deep Multimodal Fusion Networks using Graph-Induced Kernels

2017-07-03 · Dhanesh Ramachandram, Michal Lisicki, Timothy J. Shields, Mohamed R. Amer 외

A popular testbed for deep learning has been multimodal recognition of human activity or gesture involving diverse inputs such as video, audio, skeletal pose and depth images. Deep learning architectures have excelled on…

Activity RecognitionBayesian OptimizationDeep LearningHuman Activity Recognition