paper-with-me

Papers

Instance Segmentation based Semantic Matting for Compositing Applications

2019-04-10 · Guanqing Hu, James J. Clark

Image compositing is a key step in film making and image editing that aims to segment a foreground object and combine it with a new background. Automatic image compositing can be done easily in a studio using chroma-keying when the background is pure blue or green. However, image compositing in natural scenes with complex backgrounds remains a tedious task, requiring experienced artists to hand-segment. In order to achieve automatic compositing in natural scenes, we propose a fully automated method that integrates instance segmentation and image matting processes to generate high-quality semantic mattes that can be used for image editing task. Our approach can be seen both as a refinement of existing instance segmentation algorithms and as a fully automated semantic image matting method. It extends automatic image compositing techniques such as chroma-keying to scenes with complex natural backgrounds without the need for any kind of user interaction. The output of our approach can be considered as both refined instance segmentations and alpha mattes with semantic meanings. We provide experimental results which show improved performance results as compared to existing approaches.

📄 PDF Abstract BibTeX arXiv:1904.05457

Code (0)

등록된 구현이 없습니다.

Tasks

Image MattingInstance SegmentationSemantic Image MattingSemantic Segmentation

Similar Papers 제목 키워드 기반

End-to-End Human Instance Matting

2024-03-03 · Qinglin Liu, Shengping Zhang, Quanling Meng, Bineng Zhong 외

Human instance matting aims to estimate an alpha matte for each human instance in an image, which is extremely challenging and has rarely been studied so far. Despite some efforts to use instance segmentation to generate…

Image MattingInstance SegmentationSemantic Segmentation

Robust Human Matting via Semantic Guidance

2022-10-11 · Xiangguang Chen, Ye Zhu, Yu Li, Bingtao Fu 외

Automatic human matting is highly desired for many real applications. We investigate recent human matting methods and show that common bad cases happen when semantic human segmentation fails. This indicates that semantic…

Image MattingSegmentation

Deep Image Compositing

2020-11-04 · He Zhang, Jianming Zhang, Federico Perazzi, Zhe Lin 외

Image compositing is a task of combining regions from different images to compose a new image. A common use case is background replacement of portrait images. To obtain high quality composites, professionals typically ma…

Image Matting

Uncertainty-Guided Face Matting for Occlusion-Aware Face Transformation

2025-08-05 · Hyebin Cho, Jaehyup Lee arxiv

Face filters have become a key element of short-form video content, enabling a wide array of visual effects such as stylization and face swapping. However, their performance often degrades in the presence of occlusions, …

Knowledge DistillationFace Swapping

Video Instance Matting

2023-11-07 · Jiachen Li, Roberto Henschel, Vidit Goel, Marianna Ohanyan 외

Conventional video matting outputs one alpha matte for all instances appearing in a video frame so that individual instances are not distinguished. While video instance segmentation provides time-consistent instance mask…

BinarizationImage MattingInstance SegmentationSemantic Segmentation+2