Matting by Generation
This paper introduces an innovative approach for image matting that redefines the traditional regression-based task as a generative modeling challenge. Our method harnesses the capabilities of latent diffusion models, enriched with extensive pre-trained knowledge, to regularize the matting process. We present novel architectural innovations that empower our model to produce mattes with superior resolution and detail. The proposed method is versatile and can perform both guidance-free and guidance-based image matting, accommodating a variety of additional cues. Our comprehensive evaluation across three benchmark datasets demonstrates the superior performance of our approach, both quantitatively and qualitatively. The results not only reflect our method's robust effectiveness but also highlight its ability to generate visually compelling mattes that approach photorealistic quality. The project page for this paper is available at https://lightchaserx.github.io/matting-by-generation/
Code (0)
등록된 구현이 없습니다.
Tasks
Image MattingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
DiffuMatting: Synthesizing Arbitrary Objects with Matting-level Annotation
Due to the difficulty and labor-consuming nature of getting highly accurate or matting annotations, there only exists a limited amount of highly accurate labels available to the public. To tackle this challenge, we propo…
Image MattingObjectSemantic-guided Automatic Natural Image Matting with Trimap Generation Network and Light-weight Non-local Attention
Natural image matting aims to precisely separate foreground objects from background using alpha matte. Fully automatic natural image matting without external annotation is challenging. Well-performed matting methods usua…
Foreground SegmentationImage MattingSegmentationAttention-guided Temporally Coherent Video Object Matting
This paper proposes a novel deep learning-based video object matting method that can achieve temporally coherent matting results. Its key component is an attention-based temporal aggregation module that maximizes image m…
Image MattingObjectSemantic SegmentationVideo Matting+2VRMDiff: Text-Guided Video Referring Matting Generation of Diffusion
We propose a new task, video referring matting, which obtains the alpha matte of a specified instance by inputting a referring caption. We treat the dense prediction task of matting as video generation, leveraging the te…
Image MattingVideo AlignmentVideo GenerationAutomatic Trimap Generation for Image Matting
Image matting is a longstanding problem in computational photography. Although, it has been studied for more than two decades, yet there is a challenge of developing an automatic matting algorithm which does not require …
Image Matting