paper-with-me

홈 › Papers

Boosting General Trimap-free Matting in the Real-World Image

2024-05-28 · Leo Shan Wenzhang Zhou Grace Zhao

Image matting aims to obtain an alpha matte that separates foreground objects from the background accurately. Recently, trimap-free matting has been well studied because it requires only the original image without any extra input. Such methods usually extract a rough foreground by itself to take place trimap as further guidance. However, the definition of 'foreground' lacks a unified standard and thus ambiguities arise. Besides, the extracted foreground is sometimes incomplete due to inadequate network design. Most importantly, there is not a large-scale real-world matting dataset, and current trimap-free methods trained with synthetic images suffer from large domain shift problems in practice. In this paper, we define the salient object as foreground, which is consistent with human cognition and annotations of the current matting dataset. Meanwhile, data and technologies in salient object detection can be transferred to matting in a breeze. To obtain a more accurate and complete alpha matte, we propose a network called \textbf{M}ulti-\textbf{F}eature fusion-based \textbf{C}oarse-to-fine Network \textbf{(MFC-Net)}, which fully integrates multiple features for an accurate and complete alpha matte. Furthermore, we introduce image harmony in data composition to bridge the gap between synthetic and real images. More importantly, we establish the largest general matting dataset \textbf{(Real-19k)} in the real world to date. Experiments show that our method is significantly effective on both synthetic and real-world images, and the performance in the real-world dataset is far better than existing matting-free methods. Our code and data will be released soon.

📄 PDF Abstract BibTeX arXiv:2405.17916

Code (0)

등록된 구현이 없습니다.

Tasks

Image Mattingobject-detectionObject DetectionSalient Object Detection

Similar Papers 제목 키워드 기반

Learning Trimaps via Clicks for Image Matting

2024-03-30 · Chenyi Zhang, Yihan Hu, Henghui Ding, Humphrey Shi 외

Despite significant advancements in image matting, existing models heavily depend on manually-drawn trimaps for accurate results in natural image scenarios. However, the process of obtaining trimaps is time-consuming, la…

Image Matting

Improved Image Matting via Real-time User Clicks and Uncertainty Estimation

2020-12-15 · CVPR 2021 1 · Tianyi Wei, Dongdong Chen, Wenbo Zhou, Jing Liao 외

Image matting is a fundamental and challenging problem in computer vision and graphics. Most existing matting methods leverage a user-supplied trimap as an auxiliary input to produce good alpha matte. However, obtaining …

Image Matting

Deep Image Matting with Flexible Guidance Input

2021-10-21 · Hang Cheng, Shugong Xu, Xiufeng Jiang, Rongrong Wang

Image matting is an important computer vision problem. Many existing matting methods require a hand-made trimap to provide auxiliary information, which is very expensive and limits the real world usage. Recently, some tr…

Image Matting

Boosting Robustness of Image Matting with Context Assembling and Strong Data Augmentation

2022-01-18 · CVPR 2022 1 · Yutong Dai, Brian Price, He Zhang, Chunhua Shen

Deep image matting methods have achieved increasingly better results on benchmarks (e.g., Composition-1k/alphamatting.com). However, the robustness, including robustness to trimaps and generalization to images from diffe…

Data AugmentationDecoderImage Matting

Automatic Trimap Generation for Image Matting

2017-07-02 · Vikas Gupta, Shanmuganathan Raman

Image matting is a longstanding problem in computational photography. Although, it has been studied for more than two decades, yet there is a challenge of developing an automatic matting algorithm which does not require …

Image Matting