paper-with-me

홈 › Papers

Integrating Features for Recognizing Human Activities through Optimized Parameters in Graph Convolutional Networks and Transformer Architectures

2024-08-29 · Mohammad Belal, Taimur Hassan, Abdelfatah Hassan, Nael Alsheikh, Noureldin Elhendawi, Irfan Hussain

Human activity recognition is a major field of study that employs computer vision, machine vision, and deep learning techniques to categorize human actions. The field of deep learning has made significant progress, with architectures that are extremely effective at capturing human dynamics. This study emphasizes the influence of feature fusion on the accuracy of activity recognition. This technique addresses the limitation of conventional models, which face difficulties in identifying activities because of their limited capacity to understand spatial and temporal features. The technique employs sensory data obtained from four publicly available datasets: HuGaDB, PKU-MMD, LARa, and TUG. The accuracy and F1-score of two deep learning models, specifically a Transformer model and a Parameter-Optimized Graph Convolutional Network (PO-GCN), were evaluated using these datasets. The feature fusion technique integrated the final layer features from both models and inputted them into a classifier. Empirical evidence demonstrates that PO-GCN outperforms standard models in activity recognition. HuGaDB demonstrated a 2.3% improvement in accuracy and a 2.2% increase in F1-score. TUG showed a 5% increase in accuracy and a 0.5% rise in F1-score. On the other hand, LARa and PKU-MMD achieved lower accuracies of 64% and 69% respectively. This indicates that the integration of features enhanced the performance of both the Transformer model and PO-GCN.

📄 PDF Abstract BibTeX arXiv:2408.16442

Code (0)

등록된 구현이 없습니다.

Tasks

Activity RecognitionDeep LearningHuman Activity RecognitionHuman Dynamics

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Position-Wise Feed-Forward Layer 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

Recognizing Fine-Grained and Composite Activities using Hand-Centric Features and Script Data

2015-02-23 · Marcus Rohrbach, Anna Rohrbach, Michaela Regneri, Sikandar Amin 외

Activity recognition has shown impressive progress in recent years. However, the challenges of detecting fine-grained activities and understanding how they are combined into composite activities have been largely overloo…

Activity Recognition

A Markovian-based Approach for Daily Living Activities Recognition

2016-03-10 · Zaineb Liouane, Tayeb Lemlouma, Philippe Roose, Frédéric Weis 외

Recognizing the activities of daily living plays an important role in healthcare. It is necessary to use an adapted model to simulate the human behavior in a domestic space to monitor the patient harmonically and to inte…

Human Gaze Guided Attention for Surgical Activity Recognition

2022-03-09 · Abdishakour Awale, Duygu Sarikaya

Modeling and automatically recognizing surgical activities are fundamental steps toward automation in surgery and play important roles in providing timely feedback to surgeons. Accurately recognizing surgical activities …

Activity RecognitionVideo Understanding

Action2Activity: Recognizing Complex Activities from Sensor Data

2016-11-07 · Ye Liu, Liqiang Nie, Lei Han, Luming Zhang 외

As compared to simple actions, activities are much more complex, but semantically consistent with a human's real life. Techniques for action recognition from sensor generated data are mature. However, there has been rela…

Action RecognitionActivity RecognitionMulti-Task LearningTemporal Action Localization

Unstructured Human Activity Detection from RGBD Images

2012-06-28 · 2012 IEEE International Conference on Robotics and Automation 2012 6 · Jaeyong Sung, Colin Ponce, Bart Selman, Ashutosh Saxena

Being able to detect and recognize human activities is essential for several applications, including personal assistive robotics. In this paper, we perform detection and recognition of unstructured human activity in unst…

Action DetectionActivity Detection