paper-with-me

홈 › Papers

Human De-occlusion: Invisible Perception and Recovery for Humans

2021-03-22 · CVPR 2021 1 · Qiang Zhou, Shiyin Wang, Yitong Wang, Zilong Huang, Xinggang Wang

In this paper, we tackle the problem of human de-occlusion which reasons about occluded segmentation masks and invisible appearance content of humans. In particular, a two-stage framework is proposed to estimate the invisible portions and recover the content inside. For the stage of mask completion, a stacked network structure is devised to refine inaccurate masks from a general instance segmentation model and predict integrated masks simultaneously. Additionally, the guidance from human parsing and typical pose masks are leveraged to bring prior information. For the stage of content recovery, a novel parsing guided attention module is applied to isolate body parts and capture context information across multiple scales. Besides, an Amodal Human Perception dataset (AHP) is collected to settle the task of human de-occlusion. AHP has advantages of providing annotations from real-world scenes and the number of humans is comparatively larger than other amodal perception datasets. Based on this dataset, experiments demonstrate that our method performs over the state-of-the-art techniques in both tasks of mask completion and content recovery. Our AHP dataset is available at \url{https://sydney0zq.github.io/ahp/}.

📄 PDF Abstract BibTeX arXiv:2103.11597

Code (0)

등록된 구현이 없습니다.

Tasks

Human ParsingInstance SegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

Multiple Planar Object Tracking

2023-01-01 · ICCV 2023 1 · Zhicheng Zhang, Shengzhe Liu, Jufeng Yang

Tracking both location and pose of multiple planar objects (MPOT) is of great significance to numerous real-world applications. The greater degree-of-freedom of planar objects compared with common objects makes MPOT …

ObjectObject Tracking

See, Hear, and Feel: Smart Sensory Fusion for Robotic Manipulation

2022-12-07 · Hao Li, Yizhi Zhang, Junzhe Zhu, Shaoxiong Wang 외

Humans use all of their senses to accomplish different tasks in everyday activities. In contrast, existing work on robotic manipulation mostly relies on one, or occasionally two modalities, such as vision and touch. In t…

Decision Making

DMAT: A Dynamic Mask-Aware Transformer for Human De-occlusion

2024-02-07 · Guoqiang Liang, Jiahao Hu, Qingyue Wang, Shizhou Zhang

Human de-occlusion, which aims to infer the appearance of invisible human parts from an occluded image, has great value in many human-related tasks, such as person re-id, and intention inference. To address this task, th…

valid

Invisible Reflections: Leveraging Infrared Laser Reflections to Target Traffic Sign Perception

2024-01-07 · Takami Sato, Sri Hrushikesh Varma Bhupathiraju, Michael Clifford, Takeshi Sugawara 외

All vehicles must follow the rules that govern traffic behavior, regardless of whether the vehicles are human-driven or Connected Autonomous Vehicles (CAVs). Road signs indicate locally active rules, such as speed limits…

Autonomous VehiclesTraffic Sign Recognition

DPMesh: Exploiting Diffusion Prior for Occluded Human Mesh Recovery

2024-04-01 · CVPR 2024 1 · Yixuan Zhu, Ao Li, Yansong Tang, Wenliang Zhao 외

The recovery of occluded human meshes presents challenges for current methods due to the difficulty in extracting effective image features under severe occlusion. In this paper, we introduce DPMesh, an innovative framewo…

DenoisingHuman Mesh Recovery