paper-with-me

Papers

Training Matting Models without Alpha Labels

2024-08-20 · Wenze Liu, Zixuan Ye, Hao Lu, Zhiguo Cao, Xiangyu Yue

The labelling difficulty has been a longstanding problem in deep image matting. To escape from fine labels, this work explores using rough annotations such as trimaps coarsely indicating the foreground/background as supervision. We present that the cooperation between learned semantics from indicated known regions and proper assumed matting rules can help infer alpha values at transition areas. Inspired by the nonlocal principle in traditional image matting, we build a directional distance consistency loss (DDC loss) at each pixel neighborhood to constrain the alpha values conditioned on the input image. DDC loss forces the distance of similar pairs on the alpha matte and on its corresponding image to be consistent. In this way, the alpha values can be propagated from learned known regions to unknown transition areas. With only images and trimaps, a matting model can be trained under the supervision of a known loss and the proposed DDC loss. Experiments on AM-2K and P3M-10K dataset show that our paradigm achieves comparable performance with the fine-label-supervised baseline, while sometimes offers even more satisfying results than human-labelled ground truth. Code is available at \url{https://github.com/poppuppy/alpha-free-matting}.

📄 PDF Abstract BibTeX arXiv:2408.10539

Code (1)

poppuppy/alpha-free-matting 공식 구현 pytorch

Tasks

2kImage Matting

Similar Papers 제목 키워드 기반

Smart Scribbles for Image Mating

2021-03-31 · Xin Yang, Yu Qiao, Shaozhe Chen, Shengfeng He 외

Image matting is an ill-posed problem that usually requires additional user input, such as trimaps or scribbles. Drawing a fne trimap requires a large amount of user effort, while using scribbles can hardly obtain satisf…

Image Matting

A Late Fusion CNN for Digital Matting

2019-06-01 · CVPR 2019 6 · Yunke Zhang, Lixue Gong, Lubin Fan, Peiran Ren 외

This paper studies the structure of a deep convolutional neural network to predict the foreground alpha matte by taking a single RGB image as input. Our network is fully convolutional with two decoder branches for the fo…

DecoderGeneral ClassificationImage Matting

End-to-End Human Instance Matting

2024-03-03 · Qinglin Liu, Shengping Zhang, Quanling Meng, Bineng Zhong 외

Human instance matting aims to estimate an alpha matte for each human instance in an image, which is extremely challenging and has rarely been studied so far. Despite some efforts to use instance segmentation to generate…

Image MattingInstance SegmentationSemantic Segmentation

Attention-Guided Hierarchical Structure Aggregation for Image Matting

2020-06-01 · CVPR 2020 6 · Yu Qiao, Yuhao Liu, Xin Yang, Dongsheng Zhou 외

Existing deep learning based matting algorithms primarily resort to high-level semantic features to improve the overall structure of alpha mattes. However, we argue that advanced semantics extracted from CNNs contribute …

Image MattingSSIM

Self-supervised Automatic Matting

2026-07-11 · Xiaonan Hu, Zhiyuan Lu, Jingdong Zhao, Hao Lu arxiv

High-quality alpha mattes are notoriously expensive to annotate, creating a fundamental data bottleneck for deep image matting. While prior work attempts to reduce annotation cost using coarser labels like trimaps or mas…

Image Matting