paper-with-me

홈 › Papers

Gesture Recognition in RGB Videos UsingHuman Body Keypoints and Dynamic Time Warping

2019-06-25 · Pascal Schneider, Raphael Memmesheimer, Ivanna Kramer, Dietrich Paulus

Gesture recognition opens up new ways for humans to intuitively interact with machines. Especially for service robots, gestures can be a valuable addition to the means of communication to, for example, draw the robot's attention to someone or something. Extracting a gesture from video data and classifying it is a challenging task and a variety of approaches have been proposed throughout the years. This paper presents a method for gesture recognition in RGB videos using OpenPose to extract the pose of a person and Dynamic Time Warping (DTW) in conjunction with One-Nearest-Neighbor (1NN) for time-series classification. The main features of this approach are the independence of any specific hardware and high flexibility, because new gestures can be added to the classifier by adding only a few examples of it. We utilize the robustness of the Deep Learning-based OpenPose framework while avoiding the data-intensive task of training a neural network ourselves. We demonstrate the classification performance of our method using a public dataset.

📄 PDF Abstract BibTeX arXiv:1906.12171

Code (1)

homer-robotics/gesture_recognition_on_rgb_video 공식 구현

Tasks

Dynamic Time WarpingGeneral ClassificationGesture RecognitionTime SeriesTime Series AnalysisTime Series Classification

Methods 이 논문이 사용한 방법론

OpenPose 설명 없음

Similar Papers 제목 키워드 기반

Towards More Realistic Human-Robot Conversation: A Seq2Seq-based Body Gesture Interaction System

2019-05-05 · Minjie Hua, Fuyuan Shi, Yibing Nan, Kai Wang 외

This paper presents a novel system that enables intelligent robots to exhibit realistic body gestures while communicating with humans. The proposed system consists of a listening model and a speaking model used in corres…

A Spatio-Temporal Multilayer Perceptron for Gesture Recognition

2022-04-25 · Adrian Holzbock, Alexander Tsaregorodtsev, Youssef Dawoud, Klaus Dietmayer 외

Gesture recognition is essential for the interaction of autonomous vehicles with humans. While the current approaches focus on combining several modalities like image features, keypoints and bone vectors, we present neur…

Autonomous VehiclesGesture RecognitionSkeleton Based Action Recognition

SocioGesture: Real-Time and Adaptive Social Gesture Perception for Human-Robot Interaction

2026-09-03 · Wenjin Fu, Li-Fan Wu, Jerin Peter, Chip Huyen 외 arxiv

Robots interacting with people must recognize not only explicit commands, but also social cues such as invitations, refusals, and unavailability. In real deployments, these cues must be inferred from noisy onboard percep…

Neural Network Based Lidar Gesture Recognition for Realtime Robot Teleoperation

2021-09-17 · Simon Chamorro, Jack Collier, François Grondin

We propose a novel low-complexity lidar gesture recognition system for mobile robot control robust to gesture variation. Our system uses a modular approach, consisting of a pose estimation module and a gesture classifier…

Data AugmentationGesture RecognitionPose Estimation

Dynamic LIBRAS Gesture Recognition via CNN over Spatiotemporal Matrix Representation

2026-03-26 · Jasmine Moreira arxiv

This paper proposes a method for dynamic hand gesture recognition based on the composition of two models: the MediaPipe Hand Landmarker, responsible for extracting 21 skeletal keypoints of the hand, and a convolutional n…

Hand Gesture Recognition