paper-with-me

홈 › Papers

Enhancing human action recognition with GAN-based data augmentation

2024-06-07 · Synthetic Data for Artificial Intelligence and Machine Learning: Tools, Techniques, and Applications II, SPIE 2024 6 · Prasanna Reddy Pulakurthi, Celso M. de Melo, Raghuveer Rao, Majid Rabbani

Deep Neural Networks (DNNs) have emerged as a powerful tool for human action recognition, yet their reliance on vast amounts of high-quality labeled data poses significant challenges. A promising alternative is to train the network on generated synthetic data. However, existing synthetic data generation pipelines require complex simulation environments. Our novel solution bypasses this requirement by employing Generative Adversarial Networks (GANs) to generate synthetic data from only a small existing real-world dataset. Our training pipeline extracts the motion from each training video and augments it across various subject appearances within the training set. This approach increases the diversity in both motion and subject representations, thus significantly enhancing the model's performance. A rigorous evaluation of the model's performance is presented under diverse scenarios, including ground and aerial views. Moreover, an insightful analysis of critical factors influencing human action recognition performance, such as gesture motion diversity and subject appearance, is presented.

📄 PDF Abstract BibTeX

Code (1)

PrasannaPulakurthi/EHAR-GAN pytorch

Tasks

Action RecognitionData AugmentationSynthetic Data Generation

Similar Papers 제목 키워드 기반

Enhancing Personality Recognition in Dialogue by Data Augmentation and Heterogeneous Conversational Graph Networks

2024-01-11 · Yahui Fu, Haiyue Song, Tianyu Zhao, Tatsuya Kawahara

Personality recognition is useful for enhancing robots' ability to tailor user-adaptive responses, thus fostering rich human-robot interactions. One of the challenges in this task is a limited number of speakers in exist…

Data Augmentation

Active Generation Network of Human Skeleton for Action Recognition

2024-01-30 · Long Liu, Xin Wang, Fangming Li, Jiayu Chen

Data generation is a data augmentation technique for enhancing the generalization ability for skeleton-based human action recognition. Most existing data generation methods face challenges to ensure the temporal consiste…

Action GenerationAction RecognitionData AugmentationDiversity+3

Synthetic Humans for Action Recognition from Unseen Viewpoints

2019-12-09 · Gül Varol, Ivan Laptev, Cordelia Schmid, Andrew Zisserman

Although synthetic training data has been shown to be beneficial for tasks such as human pose estimation, its use for RGB human action recognition is relatively unexplored. Our goal in this work is to answer the question…

Action ClassificationAction RecognitionPose EstimationTemporal Action Localization

Generative Data Augmentation for Skeleton Action Recognition

2026-04-16 · Xu Dong, Wanqing Li, Anthony Adeyemi-Ejeye, Andrew Gilbert arxiv

Skeleton-based human action recognition is a powerful approach for understanding human behaviour from pose data, but collecting large-scale, diverse, and well-annotated 3D skeleton datasets is both expensive and labor-in…

Action RecognitionData Augmentation

Skeleton-DML: Deep Metric Learning for Skeleton-Based One-Shot Action Recognition

2020-12-26 · Raphael Memmesheimer, Simon Häring, Nick Theisen, Dietrich Paulus

One-shot action recognition allows the recognition of human-performed actions with only a single training example. This can influence human-robot-interaction positively by enabling the robot to react to previously unseen…

Action RecognitionMetric LearningOne-Shot 3D Action Recognition