paper-with-me

Papers

Object-Occluded Human Shape and Pose Estimation From a Single Color Image

2020-06-01 · CVPR 2020 6 · Tianshu Zhang, Buzhen Huang, Yangang Wang

Occlusions between human and objects, especially for the activities of human-object interactions, are very common in practical applications. However, most of the existing approaches for 3D human shape and pose estimation require human bodies are well captured without occlusions or with minor self-occlusions. In this paper, we focus on the problem of directly estimating the object-occluded human shape and pose from single color images. Our key idea is to utilize a partial UV map to represent an object-occluded human body, and the full 3D human shape estimation is ultimately converted as an image inpainting problem. We propose a novel two-branch network architecture to train an end-to-end regressor via the latent feature supervision, which also includes a novel saliency map sub-net to extract the human information from object-occluded color images. To supervise the network training, we further build a novel dataset named as 3DOH50K. Several experiments are conducted to reveal the effectiveness of the proposed method. Experimental results demonstrate that the proposed method achieves the state-of-the-art comparing with previous methods. The dataset, codes are publicly available at https://www.yangangwang.com.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

3D Human Pose Estimation3D Human Shape EstimationHuman-Object Interaction DetectionImage InpaintingObjectPose Estimation

Similar Papers 제목 키워드 기반

Probabilistic Estimation of 3D Human Shape and Pose with a Semantic Local Parametric Model

2021-11-30 · Akash Sengupta, Ignas Budvytis, Roberto Cipolla

This paper addresses the problem of 3D human body shape and pose estimation from RGB images. Some recent approaches to this task predict probability distributions over human body model parameters conditioned on the input…

Pose Estimation

Explicit Occlusion Reasoning for Multi-person 3D Human Pose Estimation

2022-07-29 · Qihao Liu, Yi Zhang, Song Bai, Alan Yuille

Occlusion poses a great threat to monocular multi-person 3D human pose estimation due to large variability in terms of the shape, appearance, and position of occluders. While existing methods try to handle occlusion with…

3D Human Pose Estimation3D Multi-Person Pose Estimation (absolute)3D Multi-Person Pose Estimation (root-relative)Data Augmentation+1

SIMstack: A Generative Shape and Instance Model for Unordered Object Stacks

2021-03-30 · ICCV 2021 10 · Zoe Landgraf, Raluca Scona, Tristan Laidlow, Stephen James 외

By estimating 3D shape and instances from a single view, we can capture information about an environment quickly, without the need for comprehensive scanning and multi-view fusion. Solving this task for composite scenes …

Instance SegmentationSegmentationSemantic Segmentationvalid

Amodal Segmentation Based on Visible Region Segmentation and Shape Prior

2020-12-10 · Yuting Xiao, Yanyu Xu, Ziming Zhong, Weixin Luo 외

Almost all existing amodal segmentation methods make the inferences of occluded regions by using features corresponding to the whole image. This is against the human's amodal perception, where human uses the visible part…

Segmentation

Occluded Human Pose Estimation based on Limb Joint Augmentation

2024-10-13 · Gangtao Han, Chunxiao Song, Song Wang, Hao Wang 외

Human pose estimation aims at locating the specific joints of humans from the images or videos. While existing deep learning-based methods have achieved high positioning accuracy, they often struggle with generalization …

Pose Estimation