paper-with-me

홈 › Papers

DPoser: Diffusion Model as Robust 3D Human Pose Prior

2023-12-09 · Junzhe Lu, Jing Lin, Hongkun Dou, Ailing Zeng, Yue Deng, Yulun Zhang, Haoqian Wang

This work targets to construct a robust human pose prior. However, it remains a persistent challenge due to biomechanical constraints and diverse human movements. Traditional priors like VAEs and NDFs often exhibit shortcomings in realism and generalization, notably with unseen noisy poses. To address these issues, we introduce DPoser, a robust and versatile human pose prior built upon diffusion models. DPoser regards various pose-centric tasks as inverse problems and employs variational diffusion sampling for efficient solving. Accordingly, designed with optimization frameworks, DPoser seamlessly benefits human mesh recovery, pose generation, pose completion, and motion denoising tasks. Furthermore, due to the disparity between the articulated poses and structured images, we propose truncated timestep scheduling to enhance the effectiveness of DPoser. Our approach demonstrates considerable enhancements over common uniform scheduling used in image domains, boasting improvements of 5.4%, 17.2%, and 3.8% across human mesh recovery, pose completion, and motion denoising, respectively. Comprehensive experiments demonstrate the superiority of DPoser over existing state-of-the-art pose priors across multiple tasks.

📄 PDF Abstract BibTeX arXiv:2312.05541

Code (1)

moonbow721/dposer 공식 구현 pytorch

Tasks

DenoisingHuman Mesh RecoveryScheduling

Methods 이 논문이 사용한 방법론

Focus 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

DPoser-X: Diffusion Model as Robust 3D Whole-body Human Pose Prior

2025-08-01 · Junzhe Lu, Jing Lin, Hongkun Dou, Ailing Zeng 외 arxiv

We present DPoser-X, a diffusion-based prior model for 3D whole-body human poses. Building a versatile and robust full-body human pose prior remains challenging due to the inherent complexity of articulated human poses a…

HumanGif: Single-View Human Diffusion with Generative Prior

2025-02-17 · Shoukang Hu, Takuya Narihira, Kazumi Fukuda, Ryosuke Sawata 외

While previous single-view-based 3D human reconstruction methods made significant progress in novel view synthesis, it remains a challenge to synthesize both view-consistent and pose-consistent results for animatable hum…

3D Human ReconstructionNeRFNovel View Synthesis

COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimation

2024-08-29 · Jiefeng Li, Ye Yuan, Davis Rempe, Haotian Zhang 외

Estimating global human motion from moving cameras is challenging due to the entanglement of human and camera motions. To mitigate the ambiguity, existing methods leverage learned human motion priors, which however often…

Motion Estimation

Distribution-Aligned Diffusion for Human Mesh Recovery

2023-08-25 · ICCV 2023 1 · Lin Geng Foo, Jia Gong, Hossein Rahmani, Jun Liu

Recovering a 3D human mesh from a single RGB image is a challenging task due to depth ambiguity and self-occlusion, resulting in a high degree of uncertainty. Meanwhile, diffusion models have recently seen much success i…

DenoisingHuman Mesh Recovery

Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models

2024-06-12 · Yuxuan Xue, Xianghui Xie, Riccardo Marin, Gerard Pons-Moll

Creating realistic avatars from a single RGB image is an attractive yet challenging problem. Due to its ill-posed nature, recent works leverage powerful prior from 2D diffusion models pretrained on large datasets. Althou…

3D Reconstruction