A Generative Adversarial Framework for Optimizing Image Matting and Harmonization Simultaneously
Image matting and image harmonization are two important tasks in image composition. Image matting, aiming to achieve foreground boundary details, and image harmonization, aiming to make the background compatible with the foreground, are both promising yet challenging tasks. Previous works consider optimizing these two tasks separately, which may lead to a sub-optimal solution. We propose to optimize matting and harmonization simultaneously to get better performance on both the two tasks and achieve more natural results. We propose a new Generative Adversarial (GAN) framework which optimizing the matting network and the harmonization network based on a self-attention discriminator. The discriminator is required to distinguish the natural images from different types of fake synthesis images. Extensive experiments on our constructed dataset demonstrate the effectiveness of our proposed method. Our dataset and dataset generating pipeline can be found in \url{https://git.io/HaMaGAN}
Code (0)
등록된 구현이 없습니다.
Tasks
Image HarmonizationImage MattingSimilar Papers 제목 키워드 기반
AlphaGAN: Generative adversarial networks for natural image matting
We present the first generative adversarial network (GAN) for natural image matting. Our novel generator network is trained to predict visually appealing alphas with the addition of the adversarial loss from the discrimi…
DecoderGenerative Adversarial NetworkImage MattingDeeply Matting-based Dual Generative Adversarial Network for Image and Document Label Supervision
Although many methods have been proposed to deal with nature image super-resolution (SR) and get impressive performance, the text images SR is not good due to their ignorance of document images. In this paper, we propose…
Generative Adversarial NetworkImage MattingImage Super-ResolutionSuper-ResolutionGenerative Adversarial Training for Weakly Supervised Cloud Matting
The detection and removal of cloud in remote sensing images are essential for earth observation applications. Most previous methods consider cloud detection as a pixel-wise semantic segmentation process (cloud v.s. backg…
Cloud DetectionEarth ObservationImage MattingSemantic SegmentationPath-Adaptive Matting for Efficient Inference Under Various Computational Cost Constraints
In this paper, we explore a novel image matting task aimed at achieving efficient inference under various computational cost constraints, specifically FLOP limitations, using a single matting network. Existing matting me…
Bilevel OptimizationImage MattingSelf-supervised Matting-specific Portrait Enhancement and Generation
We resolve the ill-posed alpha matting problem from a completely different perspective. Given an input portrait image, instead of estimating the corresponding alpha matte, we focus on the other end, to subtly enhance thi…
Image MattingSpecificity