paper-with-me

Papers

High-Resolution Deep Image Matting

2020-09-14 · Haichao Yu, Ning Xu, Zilong Huang, Yuqian Zhou, Humphrey Shi

Image matting is a key technique for image and video editing and composition. Conventionally, deep learning approaches take the whole input image and an associated trimap to infer the alpha matte using convolutional neural networks. Such approaches set state-of-the-arts in image matting; however, they may fail in real-world matting applications due to hardware limitations, since real-world input images for matting are mostly of very high resolution. In this paper, we propose HDMatt, a first deep learning based image matting approach for high-resolution inputs. More concretely, HDMatt runs matting in a patch-based crop-and-stitch manner for high-resolution inputs with a novel module design to address the contextual dependency and consistency issues between different patches. Compared with vanilla patch-based inference which computes each patch independently, we explicitly model the cross-patch contextual dependency with a newly-proposed Cross-Patch Contextual module (CPC) guided by the given trimap. Extensive experiments demonstrate the effectiveness of the proposed method and its necessity for high-resolution inputs. Our HDMatt approach also sets new state-of-the-art performance on Adobe Image Matting and AlphaMatting benchmarks and produce impressive visual results on more real-world high-resolution images.

📄 PDF Abstract BibTeX arXiv:2009.06613

Code (0)

등록된 구현이 없습니다.

Tasks

Image MattingVideo EditingVocal Bursts Intensity Prediction

Similar Papers 제목 키워드 기반

Real-Time High-Resolution Background Matting

2020-12-14 · CVPR 2021 1 · Shanchuan Lin, Andrey Ryabtsev, Soumyadip Sengupta, Brian Curless 외

We introduce a real-time, high-resolution background replacement technique which operates at 30fps in 4K resolution, and 60fps for HD on a modern GPU. Our technique is based on background matting, where an additional fra…

4kGPUImage MattingVocal Bursts Intensity Prediction

Ultrahigh Resolution Image/Video Matting With Spatio-Temporal Sparsity

2023-01-01 · CVPR 2023 1 · Yanan sun, Chi-Keung Tang, Yu-Wing Tai

Commodity ultra-high definition (UHD) displays are becoming more affordable which demand imaging in ultra high resolution (UHR). This paper proposes SparseMat, a computationally efficient approach for UHR image/video…

Image MattingVideo Matting

Robust High-Resolution Video Matting with Temporal Guidance

2021-08-25 · Shanchuan Lin, Linjie Yang, Imran Saleemi, Soumyadip Sengupta

We introduce a robust, real-time, high-resolution human video matting method that achieves new state-of-the-art performance. Our method is much lighter than previous approaches and can process 4K at 76 FPS and HD at 104 …

4kGPUImage MattingVideo Matting+1

PP-Matting: High-Accuracy Natural Image Matting

2022-04-20 · Guowei Chen, Yi Liu, Jian Wang, Juncai Peng 외

Natural image matting is a fundamental and challenging computer vision task. It has many applications in image editing and composition. Recently, deep learning-based approaches have achieved great improvements in image m…

Image MattingSemantic SegmentationVocal Bursts Intensity Prediction

Cascade Image Matting with Deformable Graph Refinement

2021-05-06 · ICCV 2021 10 · Zijian Yu, Xuhui Li, Huijuan Huang, Wen Zheng 외

Image matting refers to the estimation of the opacity of foreground objects. It requires correct contours and fine details of foreground objects for the matting results. To better accomplish human image matting tasks, we…

Image Matting