paper-with-me

홈 › Papers

Multi-person Implicit Reconstruction from a Single Image

2021-04-19 · CVPR 2021 1 · Armin Mustafa, Akin Caliskan, Lourdes Agapito, Adrian Hilton

We present a new end-to-end learning framework to obtain detailed and spatially coherent reconstructions of multiple people from a single image. Existing multi-person methods suffer from two main drawbacks: they are often model-based and therefore cannot capture accurate 3D models of people with loose clothing and hair; or they require manual intervention to resolve occlusions or interactions. Our method addresses both limitations by introducing the first end-to-end learning approach to perform model-free implicit reconstruction for realistic 3D capture of multiple clothed people in arbitrary poses (with occlusions) from a single image. Our network simultaneously estimates the 3D geometry of each person and their 6DOF spatial locations, to obtain a coherent multi-human reconstruction. In addition, we introduce a new synthetic dataset that depicts images with a varying number of inter-occluded humans and a variety of clothing and hair styles. We demonstrate robust, high-resolution reconstructions on images of multiple humans with complex occlusions, loose clothing and a large variety of poses and scenes. Our quantitative evaluation on both synthetic and real-world datasets demonstrates state-of-the-art performance with significant improvements in the accuracy and completeness of the reconstructions over competing approaches.

📄 PDF Abstract BibTeX arXiv:2104.09283

Code (0)

등록된 구현이 없습니다.

Tasks

3D geometry3D Human Reconstruction

Similar Papers 제목 키워드 기반

3D Reconstruction of Interacting Multi-Person in Clothing from a Single Image

2024-01-12 · Junuk Cha, Hansol Lee, Jaewon Kim, Nhat Nguyen Bao Truong 외

This paper introduces a novel pipeline to reconstruct the geometry of interacting multi-person in clothing on a globally coherent scene space from a single image. The main challenge arises from the occlusion: a part of a…

3D geometry3D ReconstructionDecoder

Complete 3D Human Reconstruction From a Single Incomplete Image

2023-01-01 · CVPR 2023 1 · Junying Wang, Jae Shin Yoon, Tuanfeng Y. Wang, Krishna Kumar Singh 외

This paper presents a method to reconstruct a complete human geometry and texture from an image of a person with only partial body observed, e.g., a torso. The core challenge arises from the occlusion: there exists n…

3D Human Reconstruction

Structured 3D Features for Reconstructing Controllable Avatars

2022-12-13 · CVPR 2023 1 · Enric Corona, Mihai Zanfir, Thiemo Alldieck, Eduard Gabriel Bazavan 외

We introduce Structured 3D Features, a model based on a novel implicit 3D representation that pools pixel-aligned image features onto dense 3D points sampled from a parametric, statistical human mesh surface. The 3D poin…

3D ReconstructionNovel View SynthesisVirtual Try-on

PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization

2019-05-13 · ICCV 2019 10 · Shunsuke Saito, Zeng Huang, Ryota Natsume, Shigeo Morishima 외

We introduce Pixel-aligned Implicit Function (PIFu), a highly effective implicit representation that locally aligns pixels of 2D images with the global context of their corresponding 3D object. Using PIFu, we propose an …

3D Human Pose Estimation3D Human Reconstruction3D Object Reconstruction3D Object Reconstruction From A Single Image+4

High-Fidelity Clothed Avatar Reconstruction from a Single Image

2023-04-08 · CVPR 2023 1 · Tingting Liao, Xiaomei Zhang, Yuliang Xiu, Hongwei Yi 외

This paper presents a framework for efficient 3D clothed avatar reconstruction. By combining the advantages of the high accuracy of optimization-based methods and the efficiency of learning-based methods, we propose a co…

Vocal Bursts Intensity Prediction