paper-with-me

Papers

PAD-Hand: Physics-Aware Diffusion for Hand Motion Recovery

2026-03-27 · Elkhan Ismayilzada, Yufei Zhang, Zijun Cui arxiv

Significant advancements made in reconstructing hands from images have delivered accurate single-frame estimates, yet they often lack physics consistency and provide no notion of how confidently the motion satisfies physics. In this paper, we propose a novel physics-aware conditional diffusion framework that refines noisy pose sequences into physically plausible hand motion while estimating the physics variance in motion estimates. Building on a MeshCNN-Transformer backbone, we formulate Euler-Lagrange dynamics for articulated hands. Unlike prior works that enforce zero residuals, we treat the resulting dynamic residuals as virtual observables to more effectively integrate physics. Through a last-layer Laplace approximation, our method produces per-joint, per-time variances that measure physics consistency and offers interpretable variance maps indicating where physical consistency weakens. Experiments on two well-known hand datasets show consistent gains over strong image-based initializations and competitive video-based methods. Qualitative results confirm that our variance estimations are aligned with the physical plausibility of the motion in image-based estimates.

📄 PDF Abstract BibTeX arXiv:2603.26068

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Diffusion-based 3D Hand Motion Recovery with Intuitive Physics

2025-08-03 · Yufei Zhang, Zijun Cui, Jeffrey O. Kephart, Qiang Ji arxiv

While 3D hand reconstruction from monocular images has made significant progress, generating accurate and temporally coherent motion estimates from videos remains challenging, particularly during hand-object interactions…

PhysMoDPO: Physically-Plausible Humanoid Motion with Preference Optimization

2026-03-13 · Yangsong Zhang, Anujith Muraleedharan, Rikhat Akizhanov, Abdul Ahad Butt 외 arxiv

Recent progress in text-conditioned human motion generation has been largely driven by diffusion models trained on large-scale human motion data. Building on this progress, recent methods attempt to transfer such models …

Learning Geometry-Aware Nonprehensile Pushing and Pulling with Dexterous Hands

2025-09-22 · Yunshuang Li, Yiyang Ling, Gaurav S. Sukhatme, Daniel Seita arxiv

Nonprehensile manipulation, such as pushing and pulling, enables robots to move, align, or reposition objects that may be difficult to grasp due to their geometry, size, or relationship to the robot or the environment. M…

Sketch2Motion: Text-driven 2D Sketch to 3D Animation via Diffusion-guided Skeleton Optimization

2026-05-27 · Gaurav Rai, Ojaswa Sharma arxiv

Animation of 2D hand-drawn sketches provides an effective medium for visual communication. However, these sketches pose challenges, particularly in handling occlusions and accurately mapping motion. While 3D animation na…

Motion Synthesis

Novel Diffusion Models for Multimodal 3D Hand Trajectory Prediction

2025-04-10 · Junyi Ma, Wentao Bao, Jingyi Xu, Guanzhong Sun 외

Predicting hand motion is critical for understanding human intentions and bridging the action space between human movements and robot manipulations. Existing hand trajectory prediction (HTP) methods forecast the future h…

DenoisingMambaTrajectory Prediction