paper-with-me

Papers

Exploring the Impact of Synthetic Data on Human Gesture Recognition Tasks Using GANs

2024-12-09 · George Kontogiannis, Pantelis Tzamalis, Sotiris Nikoletseas

In the evolving domain of Human Activity Recognition (HAR) using Internet of Things (IoT) devices, there is an emerging interest in employing Deep Generative Models (DGMs) to address data scarcity, enhance data quality, and improve classification metrics scores. Among these types of models, Generative Adversarial Networks (GANs) have arisen as a powerful tool for generating synthetic data that mimic real-world scenarios with high fidelity. However, Human Gesture Recognition (HGR), a subset of HAR, particularly in healthcare applications, using time series data such as allergic gestures, remains highly unexplored. In this paper, we examine and evaluate the performance of two GANs in the generation of synthetic gesture motion data that compose a part of an open-source benchmark dataset. The data is related to the disease identification domain and healthcare, specifically to allergic rhinitis. We also focus on these AI models' performance in terms of fidelity, diversity, and privacy. Furthermore, we examine the scenario if the synthetic data can substitute real data, in training scenarios and how well models trained on synthetic data can be generalized for the allergic rhinitis gestures. In our work, these gestures are related to 6-axes accelerometer and gyroscope data, serving as multi-variate time series instances, and retrieved from smart wearable devices. To the best of our knowledge, this study is the first to explore the feasibility of synthesizing motion gestures for allergic rhinitis from wearable IoT device data using Generative Adversarial Networks (GANs) and testing their impact on the generalization of gesture recognition systems. It is worth noting that, even if our method has been applied to a specific category of gestures, it is designed to be generalized and can be deployed also to other motion data in the HGR domain.

📄 PDF Abstract BibTeX arXiv:2412.06389

Code (0)

등록된 구현이 없습니다.

Tasks

Activity RecognitionGesture RecognitionHuman Activity RecognitionTime Series

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

A Multi-label Classification Approach to Increase Expressivity of EMG-based Gesture Recognition

2023-09-13 · Niklas Smedemark-Margulies, Yunus Bicer, Elifnur Sunger, Stephanie Naufel 외

Objective: The objective of the study is to efficiently increase the expressivity of surface electromyography-based (sEMG) gesture recognition systems. Approach: We use a problem transformation approach, in which actions…

Gesture RecognitionMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONSynthetic Data Generation

UserBoost: Generating User-specific Synthetic Data for Faster Enrolment into Behavioural Biometric Systems

2024-07-12 · George Webber, Jack Sturgess, Ivan Martinovic

Behavioural biometric authentication systems entail an enrolment period that is burdensome for the user. In this work, we explore generating synthetic gestures from a few real user gestures with generative deep learning,…

Diversity

Investigating the impact of 2D gesture representation on co-speech gesture generation

2024-06-21 · Teo Guichoux, Laure Soulier, Nicolas Obin, Catherine Pelachaud

Co-speech gestures play a crucial role in the interactions between humans and embodied conversational agents (ECA). Recent deep learning methods enable the generation of realistic, natural co-speech gestures synchronized…

3D Pose EstimationGesture GenerationPose Estimation

An Evaluation of Large Pre-Trained Models for Gesture Recognition using Synthetic Videos

2024-10-03 · Arun Reddy, Ketul Shah, Corban Rivera, William Paul 외

In this work, we explore the possibility of using synthetically generated data for video-based gesture recognition with large pre-trained models. We consider whether these models have sufficiently robust and expressive r…

ClassificationGesture Recognitionzero-shot-classificationZero-Shot Learning

Human-Cobot collaboration's impact on success, time completion, errors, workload, gestures and acceptability during an assembly task

2024-05-28 · Étienne Fournier, Christine Jeoffrion, Belal Hmedan, Damien Pellier 외

The 5.0 industry promotes collaborative robots (cobots). This research studies the impacts of cobot collaboration using an experimental setup. 120 participants realized a simple and a complex assembly task. 50% collabora…