paper-with-me

홈 › Papers

Learning Dense UV Completion for Human Mesh Recovery

2023-07-20 · Yanjun Wang, Qingping Sun, Wenjia Wang, Jun Ling, Zhongang Cai, Rong Xie, Li Song

Human mesh reconstruction from a single image is challenging in the presence of occlusion, which can be caused by self, objects, or other humans. Existing methods either fail to separate human features accurately or lack proper supervision for feature completion. In this paper, we propose Dense Inpainting Human Mesh Recovery (DIMR), a two-stage method that leverages dense correspondence maps to handle occlusion. Our method utilizes a dense correspondence map to separate visible human features and completes human features on a structured UV map dense human with an attention-based feature completion module. We also design a feature inpainting training procedure that guides the network to learn from unoccluded features. We evaluate our method on several datasets and demonstrate its superior performance under heavily occluded scenarios compared to other methods. Extensive experiments show that our method obviously outperforms prior SOTA methods on heavily occluded images and achieves comparable results on the standard benchmarks (3DPW).

📄 PDF Abstract BibTeX arXiv:2307.11074

Code (0)

등록된 구현이 없습니다.

Tasks

Human Mesh Recovery

Methods 이 논문이 사용한 방법론

fail 설명 없음
Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.

Similar Papers 제목 키워드 기반

LiDAR-HMR: 3D Human Mesh Recovery from LiDAR

2023-11-20 · Bohao Fan, Wenzhao Zheng, Jianjiang Feng, Jie zhou

In recent years, point cloud perception tasks have been garnering increasing attention. This paper presents the first attempt to estimate 3D human body mesh from sparse LiDAR point clouds. We found that the major challen…

3D Human Pose EstimationHuman Mesh Recovery

Self-supervised Human Mesh Recovery with Cross-Representation Alignment

2022-09-10 · Xuan Gong, Meng Zheng, Benjamin Planche, Srikrishna Karanam 외

Fully supervised human mesh recovery methods are data-hungry and have poor generalizability due to the limited availability and diversity of 3D-annotated benchmark datasets. Recent progress in self-supervised human mesh …

DiversityHuman Mesh Recovery

Deformable Mesh Transformer for 3D Human Mesh Recovery

2023-01-01 · CVPR 2023 1 · Yusuke Yoshiyasu

We present Deformable mesh transFormer (DeFormer), a novel vertex-based approach to monocular 3D human mesh recovery. DeFormer iteratively fits a body mesh model to an input image via a mesh alignment feedback loop f…

3D Hand Pose Estimation3D Human Pose EstimationDecoderHuman Mesh Recovery

3DBooSTeR: 3D Body Shape and Texture Recovery

2020-10-23 · Alexandre Saint, Anis Kacem, Kseniya Cherenkova, Djamila Aouada

We propose 3DBooSTeR, a novel method to recover a textured 3D body mesh from a textured partial 3D scan. With the advent of virtual and augmented reality, there is a demand for creating realistic and high-fidelity digita…

Decoder

DPoser: Diffusion Model as Robust 3D Human Pose Prior

2023-12-09 · Junzhe Lu, Jing Lin, Hongkun Dou, Ailing Zeng 외

This work targets to construct a robust human pose prior. However, it remains a persistent challenge due to biomechanical constraints and diverse human movements. Traditional priors like VAEs and NDFs often exhibit short…

DenoisingHuman Mesh RecoveryScheduling