paper-with-me

Papers

UniHands: Unifying Various Wild-Collected Keypoints for Personalized Hand Reconstruction

2024-11-18 · Menghe Zhang, Joonyeoup Kim, Yangwen Liang, Shuangquan Wang, Kee-Bong Song

Accurate hand motion capture and standardized 3D representation are essential for various hand-related tasks. Collecting keypoints-only data, while efficient and cost-effective, results in low-fidelity representations and lacks surface information. Furthermore, data inconsistencies across sources challenge their integration and use. We present UniHands, a novel method for creating standardized yet personalized hand models from wild-collected keypoints from diverse sources. Unlike existing neural implicit representation methods, UniHands uses the widely-adopted parametric models MANO and NIMBLE, providing a more scalable and versatile solution. It also derives unified hand joints from the meshes, which facilitates seamless integration into various hand-related tasks. Experiments on the FreiHAND and InterHand2.6M datasets demonstrate its ability to precisely reconstruct hand mesh vertices and keypoints, effectively capturing high-degree articulation motions. Empirical studies involving nine participants show a clear preference for our unified joints over existing configurations for accuracy and naturalism (p-value 0.016).

📄 PDF Abstract BibTeX arXiv:2411.11845

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Unifying data for fine-grained visual species classification

2020-09-24 · Sayali Kulkarni, Tomer Gadot, Chen Luo, Tanya Birch 외

Wildlife monitoring is crucial to nature conservation and has been done by manual observations from motion-triggered camera traps deployed in the field. Widespread adoption of such in-situ sensors has resulted in unprece…

ClassificationGeneral Classification

Offline Goal-Conditioned Reinforcement Learning with Projective Quasimetric Planning

2025-06-23 · Anthony Kobanda, Waris Radji, Mathieu Petitbois, Odalric-Ambrym Maillard 외

Offline Goal-Conditioned Reinforcement Learning seeks to train agents to reach specified goals from previously collected trajectories. Scaling that promises to long-horizon tasks remains challenging, notably due to compo…

Metric Learningreinforcement-learningReinforcement Learning

Domain Adaptive 3D Pose Augmentation for In-the-wild Human Mesh Recovery

2022-06-21 · Zhenzhen Weng, Kuan-Chieh Wang, Angjoo Kanazawa, Serena Yeung

The ability to perceive 3D human bodies from a single image has a multitude of applications ranging from entertainment and robotics to neuroscience and healthcare. A fundamental challenge in human mesh recovery is in col…

Data AugmentationDomain AdaptationHuman Mesh Recovery

ConfLab: A Data Collection Concept, Dataset, and Benchmark for Machine Analysis of Free-Standing Social Interactions in the Wild

2022-05-10 · Chirag Raman, Jose Vargas-Quiros, Stephanie Tan, Ashraful Islam 외

Recording the dynamics of unscripted human interactions in the wild is challenging due to the delicate trade-offs between several factors: participant privacy, ecological validity, data fidelity, and logistical overheads…

Privacy Preserving

3DHR-Co: A Collaborative Test-time Refinement Framework for In-the-Wild 3D Human-Body Reconstruction Task

2023-10-02 · Jonathan Samuel Lumentut, Kyoung Mu Lee

The field of 3D human-body reconstruction (abbreviated as 3DHR) that utilizes parametric pose and shape representations has witnessed significant advancements in recent years. However, the application of 3DHR techniques …

3D Human Pose EstimationTest-time Adaptation