paper-with-me

홈 › Papers

Capturing Hand Motion with an RGB-D Sensor, Fusing a Generative Model with Salient Points

2017-04-03 · Dimitrios Tzionas, Abhilash Srikantha, Pablo Aponte, Juergen Gall

Hand motion capture has been an active research topic in recent years, following the success of full-body pose tracking. Despite similarities, hand tracking proves to be more challenging, characterized by a higher dimensionality, severe occlusions and self-similarity between fingers. For this reason, most approaches rely on strong assumptions, like hands in isolation or expensive multi-camera systems, that limit the practical use. In this work, we propose a framework for hand tracking that can capture the motion of two interacting hands using only a single, inexpensive RGB-D camera. Our approach combines a generative model with collision detection and discriminatively learned salient points. We quantitatively evaluate our approach on 14 new sequences with challenging interactions.

📄 PDF Abstract BibTeX arXiv:1704.00515

Code (2)

cvlabbonn/hands_3d_motion_viewer 공식 구현
cvlabbonn/hand_2d_gt_viewer

Tasks

Pose Tracking

Similar Papers 제목 키워드 기반

Capturing Hands in Action using Discriminative Salient Points and Physics Simulation

2015-06-06 · Dimitrios Tzionas, Luca Ballan, Abhilash Srikantha, Pablo Aponte 외

Hand motion capture is a popular research field, recently gaining more attention due to the ubiquity of RGB-D sensors. However, even most recent approaches focus on the case of a single isolated hand. In this work, we fo…

Fusing uncalibrated IMUs and handheld smartphone video to reconstruct knee kinematics

2024-05-27 · J. D. Peiffer, Kunal Shah, Shawana Anarwala, Kayan Abdou 외

Video and wearable sensor data provide complementary information about human movement. Video provides a holistic understanding of the entire body in the world while wearable sensors provide high-resolution measurements o…

Markerless Motion CaptureSensor Fusion

SurfaceXR: Fusing Smartwatch IMUs and Egocentric Hand Pose for Seamless Surface Interactions

2026-03-19 · Vasco Xu, Brian Chen, Eric J. Gonzalez, Andrea Colaço 외 arxiv

Mid-air gestures in Extended Reality (XR) often cause fatigue and imprecision. Surface-based interactions offer improved accuracy and comfort, but current egocentric vision methods struggle due to hand tracking challenge…

Gesture Recognition

Event-driven Video Frame Synthesis

2019-02-26 · Zihao W. Wang, Weixin Jiang, Kuan He, Boxin Shi 외

Temporal Video Frame Synthesis (TVFS) aims at synthesizing novel frames at timestamps different from existing frames, which has wide applications in video codec, editing and analysis. In this paper, we propose a high fra…

DeblurringDenoisingVideo Frame InterpolationVideo Prediction

SensoryT5: Infusing Sensorimotor Norms into T5 for Enhanced Fine-grained Emotion Classification

2024-03-22 · Yuhan Xia, Qingqing Zhao, Yunfei Long, Ge Xu 외

In traditional research approaches, sensory perception and emotion classification have traditionally been considered separate domains. Yet, the significant influence of sensory experiences on emotional responses is unden…

ClassificationEmotion Classification