paper-with-me

홈 › Papers

Drivable Avatar Clothing: Faithful Full-Body Telepresence with Dynamic Clothing Driven by Sparse RGB-D Input

2023-10-09 · Donglai Xiang, Fabian Prada, Zhe Cao, Kaiwen Guo, Chenglei Wu, Jessica Hodgins, Timur Bagautdinov

Clothing is an important part of human appearance but challenging to model in photorealistic avatars. In this work we present avatars with dynamically moving loose clothing that can be faithfully driven by sparse RGB-D inputs as well as body and face motion. We propose a Neural Iterative Closest Point (N-ICP) algorithm that can efficiently track the coarse garment shape given sparse depth input. Given the coarse tracking results, the input RGB-D images are then remapped to texel-aligned features, which are fed into the drivable avatar models to faithfully reconstruct appearance details. We evaluate our method against recent image-driven synthesis baselines, and conduct a comprehensive analysis of the N-ICP algorithm. We demonstrate that our method can generalize to a novel testing environment, while preserving the ability to produce high-fidelity and faithful clothing dynamics and appearance.

📄 PDF Abstract BibTeX arXiv:2310.05917

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Garment Avatars: Realistic Cloth Driving using Pattern Registration

2022-06-07 · Oshri Halimi, Fabian Prada, Tuur Stuyck, Donglai Xiang 외

Virtual telepresence is the future of online communication. Clothing is an essential part of a person's identity and self-expression. Yet, ground truth data of registered clothes is currently unavailable in the required …

SMPLX-Lite: A Realistic and Drivable Avatar Benchmark with Rich Geometry and Texture Annotations

2024-05-30 · Yujiao Jiang, Qingmin Liao, Zhaolong Wang, Xiangru Lin 외

Recovering photorealistic and drivable full-body avatars is crucial for numerous applications, including virtual reality, 3D games, and tele-presence. Most methods, whether reconstruction or generation, require large num…

EVA: Expressive Virtual Avatars from Multi-view Videos

2025-05-21 · Hendrik Junkawitsch, Guoxing Sun, Heming Zhu, Christian Theobalt 외

With recent advancements in neural rendering and motion capture algorithms, remarkable progress has been made in photorealistic human avatar modeling, unlocking immense potential for applications in virtual reality, augm…

Neural Rendering

Modeling Clothing as a Separate Layer for an Animatable Human Avatar

2021-06-28 · Donglai Xiang, Fabian Prada, Timur Bagautdinov, Weipeng Xu 외

We have recently seen great progress in building photorealistic animatable full-body codec avatars, but generating high-fidelity animation of clothing is still difficult. To address these difficulties, we propose a metho…

Inverse Rendering

Capturing and Animation of Body and Clothing from Monocular Video

2022-10-04 · Yao Feng, Jinlong Yang, Marc Pollefeys, Michael J. Black 외

While recent work has shown progress on extracting clothed 3D human avatars from a single image, video, or a set of 3D scans, several limitations remain. Most methods use a holistic representation to jointly model the bo…

Virtual Try-on