paper-with-me

Papers

Revisiting Context Aggregation for Image Matting

2023-04-03 · Qinglin Liu, Xiaoqian Lv, Quanling Meng, Zonglin Li, Xiangyuan Lan, Shuo Yang, Shengping Zhang, Liqiang Nie

Traditional studies emphasize the significance of context information in improving matting performance. Consequently, deep learning-based matting methods delve into designing pooling or affinity-based context aggregation modules to achieve superior results. However, these modules cannot well handle the context scale shift caused by the difference in image size during training and inference, resulting in matting performance degradation. In this paper, we revisit the context aggregation mechanisms of matting networks and find that a basic encoder-decoder network without any context aggregation modules can actually learn more universal context aggregation, thereby achieving higher matting performance compared to existing methods. Building on this insight, we present AEMatter, a matting network that is straightforward yet very effective. AEMatter adopts a Hybrid-Transformer backbone with appearance-enhanced axis-wise learning (AEAL) blocks to build a basic network with strong context aggregation learning capability. Furthermore, AEMatter leverages a large image training strategy to assist the network in learning context aggregation from data. Extensive experiments on five popular matting datasets demonstrate that the proposed AEMatter outperforms state-of-the-art matting methods by a large margin.

📄 PDF Abstract BibTeX arXiv:2304.01171

Code (1)

qlyoo/aematter 공식 구현 pytorch

Tasks

DecoderImage Matting

Similar Papers 제목 키워드 기반

Dual-Context Aggregation for Universal Image Matting

2024-02-28 · Qinglin Liu, Xiaoqian Lv, Wei Yu, Changyong Guo 외

Natural image matting aims to estimate the alpha matte of the foreground from a given image. Various approaches have been explored to address this problem, such as interactive matting methods that use guidance such as cl…

Image Matting

Deep Video Matting via Spatio-Temporal Alignment and Aggregation

2021-04-22 · CVPR 2021 1 · Yanan sun, Guanzhi Wang, Qiao Gu, Chi-Keung Tang 외

Despite the significant progress made by deep learning in natural image matting, there has been so far no representative work on deep learning for video matting due to the inherent technical challenges in reasoning tempo…

DecoderDeep LearningImage MattingOptical Flow Estimation+1

In-Context Matting

2024-03-23 · CVPR 2024 1 · He guo, Zixuan Ye, Zhiguo Cao, Hao Lu

We introduce in-context matting, a novel task setting of image matting. Given a reference image of a certain foreground and guided priors such as points, scribbles, and masks, in-context matting enables automatic alpha e…

Image Matting

Attention-Guided Hierarchical Structure Aggregation for Image Matting

2020-06-01 · CVPR 2020 6 · Yu Qiao, Yuhao Liu, Xin Yang, Dongsheng Zhou 외

Existing deep learning based matting algorithms primarily resort to high-level semantic features to improve the overall structure of alpha mattes. However, we argue that advanced semantics extracted from CNNs contribute …

Image MattingSSIM

Hierarchical and Progressive Image Matting

2022-10-13 · Yu Qiao, Yuhao Liu, Ziqi Wei, Yuxin Wang 외

Most matting researches resort to advanced semantics to achieve high-quality alpha mattes, and direct low-level features combination is usually explored to complement alpha details. However, we argue that appearance-agno…

Image MattingSSIM