paper-with-me

Papers

Learning Nonparametric Human Mesh Reconstruction from a Single Image without Ground Truth Meshes

2020-02-28 · Kevin Lin, Lijuan Wang, Ying Jin, Zicheng Liu, Ming-Ting Sun

Nonparametric approaches have shown promising results on reconstructing 3D human mesh from a single monocular image. Unlike previous approaches that use a parametric human model like skinned multi-person linear model (SMPL), and attempt to regress the model parameters, nonparametric approaches relax the heavy reliance on the parametric space. However, existing nonparametric methods require ground truth meshes as their regression target for each vertex, and obtaining ground truth mesh labels is very expensive. In this paper, we propose a novel approach to learn human mesh reconstruction without any ground truth meshes. This is made possible by introducing two new terms into the loss function of a graph convolutional neural network (Graph CNN). The first term is the Laplacian prior that acts as a regularizer on the reconstructed mesh. The second term is the part segmentation loss that forces the projected region of the reconstructed mesh to match the part segmentation. Experimental results on multiple public datasets show that without using 3D ground truth meshes, the proposed approach outperforms the previous state-of-the-art approaches that require ground truth meshes for training.

📄 PDF Abstract BibTeX arXiv:2003.00052

Code (0)

등록된 구현이 없습니다.

Tasks

Segmentation

Similar Papers 제목 키워드 기반

Convolutional Mesh Regression for Single-Image Human Shape Reconstruction

2019-05-08 · CVPR 2019 6 · Nikos Kolotouros, Georgios Pavlakos, Kostas Daniilidis

This paper addresses the problem of 3D human pose and shape estimation from a single image. Previous approaches consider a parametric model of the human body, SMPL, and attempt to regress the model parameters that give r…

3D geometry3D Hand Pose Estimation3D human pose and shape estimation3D Human Pose Estimation+3

MuNet: A Mutualistic Network for Joint 3D Human Mesh Recovery and 3D Clothed Human Reconstruction from Single Images

2026-05-25 · Yunqi Gao, Leyuan Liu, Yuhan Li, Changxin Gao 외 arxiv

3D human mesh recovery and 3D clothed human reconstruction are inherently related, yet they have long been studied in isolation, thereby overlooking the potential gains of joint optimization. To overcome this limitation,…

Human Mesh Recovery

MPT: Mesh Pre-Training with Transformers for Human Pose and Mesh Reconstruction

2022-11-24 · Kevin Lin, Chung-Ching Lin, Lin Liang, Zicheng Liu 외

Traditional methods of reconstructing 3D human pose and mesh from single images rely on paired image-mesh datasets, which can be difficult and expensive to obtain. Due to this limitation, model scalability is constrained…

3D Human Pose EstimationHand Pose EstimationPose Estimation

SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusion

2023-11-27 · CVPR 2024 1 · Hsuan-I Ho, Jie Song, Otmar Hilliges

A long-standing goal of 3D human reconstruction is to create lifelike and fully detailed 3D humans from single-view images. The main challenge lies in inferring unknown body shapes, appearances, and clothing details in a…

Lifelike 3D Human Generation

Leveraging the Learnable Vertex-Vertex Relationship to Generalize Human Pose and Mesh Reconstruction for In-the-Wild Scenes

2022-02-15 · Trung Tran-Quang, Cuong Than-Cao, Hai Nguyen-Thanh, Hong Hoang Si

We present MeshLeTemp, a powerful method for 3D human pose and mesh reconstruction from a single image. In terms of human body priors encoding, we propose using a learnable template human mesh instead of a constant templ…