paper-with-me

홈 › Papers

Synthetic Data Generation of Body Motion Data by Neural Gas Network for Emotion Recognition

2025-03-11 · Seyed Muhammad Hossein Mousavi

In the domain of emotion recognition using body motion, the primary challenge lies in the scarcity of diverse and generalizable datasets. Automatic emotion recognition uses machine learning and artificial intelligence techniques to recognize a person's emotional state from various data types, such as text, images, sound, and body motion. Body motion poses unique challenges as many factors, such as age, gender, ethnicity, personality, and illness, affect its appearance, leading to a lack of diverse and robust datasets specifically for emotion recognition. To address this, employing Synthetic Data Generation (SDG) methods, such as Generative Adversarial Networks (GANs) and Variational Auto Encoders (VAEs), offers potential solutions, though these methods are often complex. This research introduces a novel application of the Neural Gas Network (NGN) algorithm for synthesizing body motion data and optimizing diversity and generation speed. By learning skeletal structure topology, the NGN fits the neurons or gas particles on body joints. Generated gas particles, which form the skeletal structure later on, will be used to synthesize the new body posture. By attaching body postures over frames, the final synthetic body motion appears. We compared our generated dataset against others generated by GANs, VAEs, and another benchmark algorithm, using benchmark metrics such as Fr\'echet Inception Distance (FID), Diversity, and a few more. Furthermore, we continued evaluation using classification metrics such as accuracy, precision, recall, and a few others. Joint-related features or kinematic parameters were extracted, and the system assessed model performance against unseen data. Our findings demonstrate that the NGN algorithm produces more realistic and emotionally distinct body motion data and does so with more synthesizing speed than existing methods.

📄 PDF Abstract BibTeX arXiv:2503.14513

Code (1)

SeyedMuhammadHosseinMousavi/Synthetic-Data-Generation-of-Body-Motion-Data-by-Neural-Gas-Network-for-Emotion-Recognition 공식 구현

Tasks

DiversityEmotion RecognitionSynthetic Data Generation

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

SINC: Spatial Composition of 3D Human Motions for Simultaneous Action Generation

2023-04-20 · ICCV 2023 1 · Nikos Athanasiou, Mathis Petrovich, Michael J. Black, Gül Varol

Our goal is to synthesize 3D human motions given textual inputs describing simultaneous actions, for example 'waving hand' while 'walking' at the same time. We refer to generating such simultaneous movements as performin…

Action GenerationMotion Generation

The GENEA Challenge 2022: A large evaluation of data-driven co-speech gesture generation

2022-08-22 · Youngwoo Yoon, Pieter Wolfert, Taras Kucherenko, Carla Viegas 외

This paper reports on the second GENEA Challenge to benchmark data-driven automatic co-speech gesture generation. Participating teams used the same speech and motion dataset to build gesture-generation systems. Motion ge…

Gesture Generation

Evaluating gesture generation in a large-scale open challenge: The GENEA Challenge 2022

2023-03-15 · Taras Kucherenko, Pieter Wolfert, Youngwoo Yoon, Carla Viegas 외

This paper reports on the second GENEA Challenge to benchmark data-driven automatic co-speech gesture generation. Participating teams used the same speech and motion dataset to build gesture-generation systems. Motion ge…

Gesture Generation

HumanTOMATO: Text-aligned Whole-body Motion Generation

2023-10-19 · Shunlin Lu, Ling-Hao Chen, Ailing Zeng, Jing Lin 외

This work targets a novel text-driven whole-body motion generation task, which takes a given textual description as input and aims at generating high-quality, diverse, and coherent facial expressions, hand gestures, and …

Motion GenerationMotion Synthesis

IAM: Identity-Aware Human Motion and Shape Joint Generation

2026-04-28 · Wenqi Jia, Zekun Li, Abhay Mittal, Chengcheng Tang 외 arxiv

Recent advances in text-driven human motion generation enable models to synthesize realistic motion sequences from natural language descriptions. However, most existing approaches assume identity-neutral motion and gener…