paper-with-me

Papers

Matting by Generation

2024-07-30 · Zhixiang Wang, Baiang Li, Jian Wang, Yu-Lun Liu, Jinwei Gu, Yung-Yu Chuang, Shin'ichi Satoh

This paper introduces an innovative approach for image matting that redefines the traditional regression-based task as a generative modeling challenge. Our method harnesses the capabilities of latent diffusion models, enriched with extensive pre-trained knowledge, to regularize the matting process. We present novel architectural innovations that empower our model to produce mattes with superior resolution and detail. The proposed method is versatile and can perform both guidance-free and guidance-based image matting, accommodating a variety of additional cues. Our comprehensive evaluation across three benchmark datasets demonstrates the superior performance of our approach, both quantitatively and qualitatively. The results not only reflect our method's robust effectiveness but also highlight its ability to generate visually compelling mattes that approach photorealistic quality. The project page for this paper is available at https://lightchaserx.github.io/matting-by-generation/

📄 PDF Abstract BibTeX arXiv:2407.21017

Code (0)

등록된 구현이 없습니다.

Tasks

Image Matting

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

DiffuMatting: Synthesizing Arbitrary Objects with Matting-level Annotation

2024-03-10 · Xiaobin Hu, Xu Peng, Donghao Luo, Xiaozhong Ji 외

Due to the difficulty and labor-consuming nature of getting highly accurate or matting annotations, there only exists a limited amount of highly accurate labels available to the public. To tackle this challenge, we propo…

Image MattingObject

Semantic-guided Automatic Natural Image Matting with Trimap Generation Network and Light-weight Non-local Attention

2021-03-31 · Yuhongze Zhou, Liguang Zhou, Tin Lun Lam, Yangsheng Xu

Natural image matting aims to precisely separate foreground objects from background using alpha matte. Fully automatic natural image matting without external annotation is challenging. Well-performed matting methods usua…

Foreground SegmentationImage MattingSegmentation

Attention-guided Temporally Coherent Video Object Matting

2021-05-24 · Yunke Zhang, Chi Wang, Miaomiao Cui, Peiran Ren 외

This paper proposes a novel deep learning-based video object matting method that can achieve temporally coherent matting results. Its key component is an attention-based temporal aggregation module that maximizes image m…

Image MattingObjectSemantic SegmentationVideo Matting+2

VRMDiff: Text-Guided Video Referring Matting Generation of Diffusion

2025-03-11 · Lehan Yang, Jincen Song, Tianlong Wang, Daiqing Qi 외

We propose a new task, video referring matting, which obtains the alpha matte of a specified instance by inputting a referring caption. We treat the dense prediction task of matting as video generation, leveraging the te…

Image MattingVideo AlignmentVideo Generation

Automatic Trimap Generation for Image Matting

2017-07-02 · Vikas Gupta, Shanmuganathan Raman

Image matting is a longstanding problem in computational photography. Although, it has been studied for more than two decades, yet there is a challenge of developing an automatic matting algorithm which does not require …

Image Matting