paper-with-me

Papers

Semantic Human Matting

2018-09-05 · Quan Chen, Tiezheng Ge, Yanyu Xu, Zhiqiang Zhang, Xinxin Yang, Kun Gai

Human matting, high quality extraction of humans from natural images, is crucial for a wide variety of applications. Since the matting problem is severely under-constrained, most previous methods require user interactions to take user designated trimaps or scribbles as constraints. This user-in-the-loop nature makes them difficult to be applied to large scale data or time-sensitive scenarios. In this paper, instead of using explicit user input constraints, we employ implicit semantic constraints learned from data and propose an automatic human matting algorithm (SHM). SHM is the first algorithm that learns to jointly fit both semantic information and high quality details with deep networks. In practice, simultaneously learning both coarse semantics and fine details is challenging. We propose a novel fusion strategy which naturally gives a probabilistic estimation of the alpha matte. We also construct a very large dataset with high quality annotations consisting of 35,513 unique foregrounds to facilitate the learning and evaluation of human matting. Extensive experiments on this dataset and plenty of real images show that SHM achieves comparable results with state-of-the-art interactive matting methods.

📄 PDF Abstract BibTeX arXiv:1809.01354

Code (2)

lizhengwei1992/Semantic_Human_Matting pytorch
mindspore-ai/models/tree/master/official/cv/semantic_human_matting mindspore

Tasks

Image Matting

Similar Papers 제목 키워드 기반

Robust Human Matting via Semantic Guidance

2022-10-11 · Xiangguang Chen, Ye Zhu, Yu Li, Bingtao Fu 외

Automatic human matting is highly desired for many real applications. We investigate recent human matting methods and show that common bad cases happen when semantic human segmentation fails. This indicates that semantic…

Image MattingSegmentation

End-to-End Human Instance Matting

2024-03-03 · Qinglin Liu, Shengping Zhang, Quanling Meng, Bineng Zhong 외

Human instance matting aims to estimate an alpha matte for each human instance in an image, which is extremely challenging and has rarely been studied so far. Despite some efforts to use instance segmentation to generate…

Image MattingInstance SegmentationSemantic Segmentation

SGM-Net: Semantic Guided Matting Net

2022-08-16 · Qing Song, Wenfeng Sun, Donghan Yang, Mengjie Hu 외

Human matting refers to extracting human parts from natural images with high quality, including human detail information such as hair, glasses, hat, etc. This technology plays an essential role in image synthesis and vis…

Image GenerationImage Matting

Boosting Semantic Human Matting with Coarse Annotations

2020-04-10 · CVPR 2020 6 · Jinlin Liu, Yuan YAO, Wendi Hou, Miaomiao Cui 외

Semantic human matting aims to estimate the per-pixel opacity of the foreground human regions. It is quite challenging and usually requires user interactive trimaps and plenty of high quality annotated data. Annotating s…

Image MattingSemantic Segmentation

PP-Matting: High-Accuracy Natural Image Matting

2022-04-20 · Guowei Chen, Yi Liu, Jian Wang, Juncai Peng 외

Natural image matting is a fundamental and challenging computer vision task. It has many applications in image editing and composition. Recently, deep learning-based approaches have achieved great improvements in image m…

Image MattingSemantic SegmentationVocal Bursts Intensity Prediction