Exploring the Impact of Synthetic Data on Human Gesture Recognition Tasks Using GANs
In the evolving domain of Human Activity Recognition (HAR) using Internet of Things (IoT) devices, there is an emerging interest in employing Deep Generative Models (DGMs) to address data scarcity, enhance data quality, and improve classification metrics scores. Among these types of models, Generative Adversarial Networks (GANs) have arisen as a powerful tool for generating synthetic data that mimic real-world scenarios with high fidelity. However, Human Gesture Recognition (HGR), a subset of HAR, particularly in healthcare applications, using time series data such as allergic gestures, remains highly unexplored. In this paper, we examine and evaluate the performance of two GANs in the generation of synthetic gesture motion data that compose a part of an open-source benchmark dataset. The data is related to the disease identification domain and healthcare, specifically to allergic rhinitis. We also focus on these AI models' performance in terms of fidelity, diversity, and privacy. Furthermore, we examine the scenario if the synthetic data can substitute real data, in training scenarios and how well models trained on synthetic data can be generalized for the allergic rhinitis gestures. In our work, these gestures are related to 6-axes accelerometer and gyroscope data, serving as multi-variate time series instances, and retrieved from smart wearable devices. To the best of our knowledge, this study is the first to explore the feasibility of synthesizing motion gestures for allergic rhinitis from wearable IoT device data using Generative Adversarial Networks (GANs) and testing their impact on the generalization of gesture recognition systems. It is worth noting that, even if our method has been applied to a specific category of gestures, it is designed to be generalized and can be deployed also to other motion data in the HGR domain.
Code (0)
등록된 구현이 없습니다.
Tasks
Activity RecognitionGesture RecognitionHuman Activity RecognitionTime SeriesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Multi-label Classification Approach to Increase Expressivity of EMG-based Gesture Recognition
Objective: The objective of the study is to efficiently increase the expressivity of surface electromyography-based (sEMG) gesture recognition systems. Approach: We use a problem transformation approach, in which actions…
Gesture RecognitionMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONSynthetic Data GenerationUserBoost: Generating User-specific Synthetic Data for Faster Enrolment into Behavioural Biometric Systems
Behavioural biometric authentication systems entail an enrolment period that is burdensome for the user. In this work, we explore generating synthetic gestures from a few real user gestures with generative deep learning,…
DiversityInvestigating the impact of 2D gesture representation on co-speech gesture generation
Co-speech gestures play a crucial role in the interactions between humans and embodied conversational agents (ECA). Recent deep learning methods enable the generation of realistic, natural co-speech gestures synchronized…
3D Pose EstimationGesture GenerationPose EstimationAn Evaluation of Large Pre-Trained Models for Gesture Recognition using Synthetic Videos
In this work, we explore the possibility of using synthetically generated data for video-based gesture recognition with large pre-trained models. We consider whether these models have sufficiently robust and expressive r…
ClassificationGesture Recognitionzero-shot-classificationZero-Shot LearningHuman-Cobot collaboration's impact on success, time completion, errors, workload, gestures and acceptability during an assembly task
The 5.0 industry promotes collaborative robots (cobots). This research studies the impacts of cobot collaboration using an experimental setup. 120 participants realized a simple and a complex assembly task. 50% collabora…