paper-with-me

홈 › Papers

dugMatting: Decomposed-Uncertainty-Guided Matting

2023-06-02 · Jiawei Wu, Changqing Zhang, Zuoyong Li, Huazhu Fu, Xi Peng, Joey Tianyi Zhou

Cutting out an object and estimating its opacity mask, known as image matting, is a key task in image and video editing. Due to the highly ill-posed issue, additional inputs, typically user-defined trimaps or scribbles, are usually needed to reduce the uncertainty. Although effective, it is either time consuming or only suitable for experienced users who know where to place the strokes. In this work, we propose a decomposed-uncertainty-guided matting (dugMatting) algorithm, which explores the explicitly decomposed uncertainties to efficiently and effectively improve the results. Basing on the characteristic of these uncertainties, the epistemic uncertainty is reduced in the process of guiding interaction (which introduces prior knowledge), while the aleatoric uncertainty is reduced in modeling data distribution (which introduces statistics for both data and possible noise). The proposed matting framework relieves the requirement for users to determine the interaction areas by using simple and efficient labeling. Extensively quantitative and qualitative results validate that the proposed method significantly improves the original matting algorithms in terms of both efficiency and efficacy.

📄 PDF Abstract BibTeX arXiv:2306.01452

Code (1)

fire-friend/dugmatting 공식 구현 pytorch

Tasks

Image MattingVideo Editing

Similar Papers 제목 키워드 기반

Mask-Guided Matting in the Wild

2023-01-01 · CVPR 2023 1 · KwanYong Park, Sanghyun Woo, Seoung Wug Oh, In So Kweon 외

Mask-guided matting has shown great practicality compared to traditional trimap-based methods. The mask-guided approach takes an easily-obtainable coarse mask as guidance and produces an accurate alpha matte. To exte…

DiversityImage MattingInstance SegmentationSemantic Segmentation+1

Inductive Guided Filter: Real-time Deep Image Matting with Weakly Annotated Masks on Mobile Devices

2019-05-16 · Yaoyi Li, Jianfu Zhang, Weijie Zhao, Hongtao Lu

Recently, significant progress has been achieved in deep image matting. Most of the classical image matting methods are time-consuming and require an ideal trimap which is difficult to attain in practice. A high efficien…

Image Matting

Uncertainty-Guided Face Matting for Occlusion-Aware Face Transformation

2025-08-05 · Hyebin Cho, Jaehyup Lee arxiv

Face filters have become a key element of short-form video content, enabling a wide array of visual effects such as stylization and face swapping. However, their performance often degrades in the presence of occlusions, …

Knowledge DistillationFace Swapping

Semantic-guided Automatic Natural Image Matting with Trimap Generation Network and Light-weight Non-local Attention

2021-03-31 · Yuhongze Zhou, Liguang Zhou, Tin Lun Lam, Yangsheng Xu

Natural image matting aims to precisely separate foreground objects from background using alpha matte. Fully automatic natural image matting without external annotation is challenging. Well-performed matting methods usua…

Foreground SegmentationImage MattingSegmentation

Robust Human Matting via Semantic Guidance

2022-10-11 · Xiangguang Chen, Ye Zhu, Yu Li, Bingtao Fu 외

Automatic human matting is highly desired for many real applications. We investigate recent human matting methods and show that common bad cases happen when semantic human segmentation fails. This indicates that semantic…

Image MattingSegmentation