paper-with-me

홈 › Papers

Self-supervised Automatic Matting

2026-07-11 · Xiaonan Hu, Zhiyuan Lu, Jingdong Zhao, Hao Lu arxiv

High-quality alpha mattes are notoriously expensive to annotate, creating a fundamental data bottleneck for deep image matting. While prior work attempts to reduce annotation cost using coarser labels like trimaps or masks, they remain reliant on costly per-pixel supervision, limiting scalability and generalization. In this work, we push the boundary further and ask: can we train an automatic matting model using only RGB images, with no manual annotation at all? We answer this by presenting SSMatte, a self-supervised framework that for the first time achieves performance on par with fully-supervised automatic matting. Our key insight is to decompose the problem into semantic anchoring and detail matting. SSMatte first generates a semantic matting prompt from frozen self-supervised ViT features by propagating class-token seeds via a novel, training-efficient semantic anchoring loss based on a generalized Rayleigh quotient. This prompt then anchors a detail matting network, which is optimized via a fixed-point-based loss that enforces alpha-RGB consistency. Extensive experiments show SSMatte outperforms prior weakly-supervised methods, matches the performance of fully-supervised models on portrait benchmarks, and demonstrates favorable scaling and generalization behaviors with additional data. Our work pushes automatic matting to an fresh, fully annotation-free paradigm. Code will be available.

📄 PDF Abstract BibTeX arXiv:2607.10395

Code (0)

등록된 구현이 없습니다.

Tasks

Image Matting

Similar Papers 제목 키워드 기반

Self-supervised Matting-specific Portrait Enhancement and Generation

2022-08-13 · Yangyang Xu Zeyang Zhou, Shengfeng He

We resolve the ill-posed alpha matting problem from a completely different perspective. Given an input portrait image, instead of estimating the corresponding alpha matte, we focus on the other end, to subtly enhance thi…

Image MattingSpecificity

Disentangled Pre-training for Image Matting

2023-04-03 · Yanda Li, Zilong Huang, Gang Yu, Ling Chen 외

Image matting requires high-quality pixel-level human annotations to support the training of a deep model in recent literature. Whereas such annotation is costly and hard to scale, significantly holding back the developm…

DisentanglementImage Matting

Virtual Multi-Modality Self-Supervised Foreground Matting for Human-Object Interaction

2021-10-07 · ICCV 2021 10 · Bo Xu, Han Huang, Cheng Lu, Ziwen Li 외

Most existing human matting algorithms tried to separate pure human-only foreground from the background. In this paper, we propose a Virtual Multi-modality Foreground Matting (VMFM) method to learn human-object interacti…

DecoderHuman-Object Interaction DetectionImage Matting

Image matting with normalized weight and semi-supervised learning

2017-10-27 · Ping Li, Tingyan Duan, Yongfeng Cao

Image matting is an important vision problem. The main stream methods for it combine sampling-based methods and propagation-based methods. In this paper, we deal with the combination with a normalized weighting parameter…

Image Matting

Unsupervised Data Extraction from Computer-generated Documents with Single Line Formatting

2020-07-07 · Vladimir Bernstein, Andrei Afanassenkov

Processing large amounts of data is an essential problem of the big data era. Most of the data exchange is done via direct communication (using APIs) and well-structured file formats (JSON, XML, EDI, etc.), but a signifi…

Clustering