Learning Dense UV Completion for Human Mesh Recovery
Human mesh reconstruction from a single image is challenging in the presence of occlusion, which can be caused by self, objects, or other humans. Existing methods either fail to separate human features accurately or lack proper supervision for feature completion. In this paper, we propose Dense Inpainting Human Mesh Recovery (DIMR), a two-stage method that leverages dense correspondence maps to handle occlusion. Our method utilizes a dense correspondence map to separate visible human features and completes human features on a structured UV map dense human with an attention-based feature completion module. We also design a feature inpainting training procedure that guides the network to learn from unoccluded features. We evaluate our method on several datasets and demonstrate its superior performance under heavily occluded scenarios compared to other methods. Extensive experiments show that our method obviously outperforms prior SOTA methods on heavily occluded images and achieves comparable results on the standard benchmarks (3DPW).
Code (0)
등록된 구현이 없습니다.
Tasks
Human Mesh RecoveryMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
LiDAR-HMR: 3D Human Mesh Recovery from LiDAR
In recent years, point cloud perception tasks have been garnering increasing attention. This paper presents the first attempt to estimate 3D human body mesh from sparse LiDAR point clouds. We found that the major challen…
3D Human Pose EstimationHuman Mesh RecoverySelf-supervised Human Mesh Recovery with Cross-Representation Alignment
Fully supervised human mesh recovery methods are data-hungry and have poor generalizability due to the limited availability and diversity of 3D-annotated benchmark datasets. Recent progress in self-supervised human mesh …
DiversityHuman Mesh RecoveryDeformable Mesh Transformer for 3D Human Mesh Recovery
We present Deformable mesh transFormer (DeFormer), a novel vertex-based approach to monocular 3D human mesh recovery. DeFormer iteratively fits a body mesh model to an input image via a mesh alignment feedback loop f…
3D Hand Pose Estimation3D Human Pose EstimationDecoderHuman Mesh Recovery3DBooSTeR: 3D Body Shape and Texture Recovery
We propose 3DBooSTeR, a novel method to recover a textured 3D body mesh from a textured partial 3D scan. With the advent of virtual and augmented reality, there is a demand for creating realistic and high-fidelity digita…
DecoderDPoser: Diffusion Model as Robust 3D Human Pose Prior
This work targets to construct a robust human pose prior. However, it remains a persistent challenge due to biomechanical constraints and diverse human movements. Traditional priors like VAEs and NDFs often exhibit short…
DenoisingHuman Mesh RecoveryScheduling