paper-with-me

Papers

D^3-Human: Dynamic Disentangled Digital Human from Monocular Video

2025-01-01 · CVPR 2025 1 · Honghu Chen, Bo Peng, Yunfan Tao, Juyong Zhang

We introduce \text D ^3\text -Human , a method for reconstructing Dynamic Disentangled Digital Human geometry from monocular videos. Past monocular video human reconstruction primarily focuses on reconstructing undecoupled clothed human bodies or only reconstructing clothing, making it difficult to apply directly in applications such as animation production. The challenge in reconstructing decoupled clothing and body lies in the occlusion caused by clothing over the body. To this end, the details of the visible area and the plausibility of the invisible area must be ensured during the reconstruction process. Our proposed method combines explicit and implicit representations to model the decoupled clothed human body, leveraging the robustness of explicit representations and the flexibility of implicit representations. Specifically, we reconstruct the visible region as SDF and propose a novel human manifold signed distance field (hmSDF) to segment the visible clothing and visible body, and then merge the visible and invisible body. Extensive experimental results demonstrate that, compared with existing reconstruction schemes, \text D ^3\text -Human can achieve high-quality decoupled reconstruction of the human body wearing different clothing, and can be directly applied to clothing transfer and animation production.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

D$^3$-Human: Dynamic Disentangled Digital Human from Monocular Video

2025-01-03 · Honghu Chen, Bo Peng, Yunfan Tao, Juyong Zhang

We introduce D$^3$-Human, a method for reconstructing Dynamic Disentangled Digital Human geometry from monocular videos. Past monocular video human reconstruction primarily focuses on reconstructing undecoupled clothed h…

Neural Head Avatars from Monocular RGB Videos

2021-12-02 · CVPR 2022 1 · Philip-William Grassal, Malte Prinzler, Titus Leistner, Carsten Rother 외

We present Neural Head Avatars, a novel neural representation that explicitly models the surface geometry and appearance of an animatable human avatar that can be used for teleconferencing in AR/VR or other applications …

Novel View Synthesis

Human Mesh Recovery from Monocular Images via a Skeleton-disentangled Representation

2019-08-20 · ICCV 2019 10 · Sun Yu, Ye Yun, Liu Wu, Gao Wenpeng 외

We describe an end-to-end method for recovering 3D human body mesh from single images and monocular videos. Different from the existing methods try to obtain all the complex 3D pose, shape, and camera parameters from one…

3D Human Pose Estimation3D Pose EstimationHuman Mesh Recovery

IntrinsicAvatar: Physically Based Inverse Rendering of Dynamic Humans from Monocular Videos via Explicit Ray Tracing

2023-12-08 · CVPR 2024 1 · Shaofei Wang, Božidar Antić, Andreas Geiger, Siyu Tang

We present IntrinsicAvatar, a novel approach to recovering the intrinsic properties of clothed human avatars including geometry, albedo, material, and environment lighting from only monocular videos. Recent advancements …

DisentanglementInverse RenderingNeural Rendering

Learning Disentangled Avatars with Hybrid 3D Representations

2023-09-12 · Yao Feng, Weiyang Liu, Timo Bolkart, Jinlong Yang 외

Tremendous efforts have been made to learn animatable and photorealistic human avatars. Towards this end, both explicit and implicit 3D representations are heavily studied for a holistic modeling and capture of the whole…

Disentanglement