paper-with-me

홈 › Papers

Online Micro-gesture Recognition Using Data Augmentation and Spatial-Temporal Attention

2025-07-13 · Pengyu Liu, Kun Li, Fei Wang, Yanyan Wei, Junhui She, Dan Guo arxiv

In this paper, we introduce the latest solution developed by our team, HFUT-VUT, for the Micro-gesture Online Recognition track of the IJCAI 2025 MiGA Challenge. The Micro-gesture Online Recognition task is a highly challenging problem that aims to locate the temporal positions and recognize the categories of multiple micro-gesture instances in untrimmed videos. Compared to traditional temporal action detection, this task places greater emphasis on distinguishing between micro-gesture categories and precisely identifying the start and end times of each instance. Moreover, micro-gestures are typically spontaneous human actions, with greater differences than those found in other human actions. To address these challenges, we propose hand-crafted data augmentation and spatial-temporal attention to enhance the model's ability to classify and localize micro-gestures more accurately. Our solution achieved an F1 score of 38.03, outperforming the previous state-of-the-art by 37.9%. As a result, our method ranked first in the Micro-gesture Online Recognition track.

📄 PDF Abstract BibTeX arXiv:2507.09512

Code (0)

등록된 구현이 없습니다.

Tasks

Micro-gesture RecognitionData AugmentationAction Detection

Similar Papers 제목 키워드 기반

Micro-gesture Online Recognition using Learnable Query Points

2024-07-05 · Pengyu Liu, Fei Wang, Kun Li, Guoliang Chen 외

In this paper, we briefly introduce the solution developed by our team, HFUT-VUT, for the Micro-gesture Online Recognition track in the MiGA challenge at IJCAI 2024. The Micro-gesture Online Recognition task involves ide…

Action Detection

Spatial-Temporal Decoupled Adapter for Micro-gesture Online Recognition

2026-06-05 · Xucheng Shen, Kun Li, Fei Wang, Wei Qian 외 arxiv

Micro-gesture online recognition aims to temporally localize and classify subtle gestures in untrimmed videos. Owing to their extremely short duration, low motion amplitude, and ambiguous visual cues, capturing discrimin…

Identity-free Artificial Emotional Intelligence via Micro-Gesture Understanding

2024-05-21 · Rong Gao, Xin Liu, Bohao Xing, Zitong Yu 외

In this work, we focus on a special group of human body language -- the micro-gesture (MG), which differs from the range of ordinary illustrative gestures in that they are not intentional behaviors performed to convey in…

Action RecognitionDeception DetectionEmotional IntelligenceGesture Recognition+1

Motion Reinforces Appearance: RGB-Skeleton Gated Residual Fusion for Micro-Gesture Online Recognition

2026-06-10 · Jialin Liu, Xinwen He, Pengyu Liu, Jiale Shi 외 arxiv

Micro-gesture analysis attracts increasing attention for inferring spontaneous emotion from subtle body movements. Micro-gesture online recognition, which localizes and classifies each gesture instance in untrimmed video…

Action Detection

OMG-Bench: A New Challenging Benchmark for Skeleton-based Online Micro Hand Gesture Recognition

2025-12-18 · Haochen Chang, Pengfei Ren, Buyuan Zhang, Da Li 외 arxiv

Online micro gesture recognition from hand skeletons is critical for VR/AR interaction but faces challenges due to limited public datasets and task-specific algorithms. Micro gestures involve subtle motion patterns, whic…

Hand Gesture Recognition