paper-with-me

홈 › Papers

Robust High-Resolution Video Matting with Temporal Guidance

2021-08-25 · Shanchuan Lin, Linjie Yang, Imran Saleemi, Soumyadip Sengupta

We introduce a robust, real-time, high-resolution human video matting method that achieves new state-of-the-art performance. Our method is much lighter than previous approaches and can process 4K at 76 FPS and HD at 104 FPS on an Nvidia GTX 1080Ti GPU. Unlike most existing methods that perform video matting frame-by-frame as independent images, our method uses a recurrent architecture to exploit temporal information in videos and achieves significant improvements in temporal coherence and matting quality. Furthermore, we propose a novel training strategy that enforces our network on both matting and segmentation objectives. This significantly improves our model's robustness. Our method does not require any auxiliary inputs such as a trimap or a pre-captured background image, so it can be widely applied to existing human matting applications.

📄 PDF Abstract BibTeX arXiv:2108.11515

Code (1)

PeterL1n/RobustVideoMatting 공식 구현 pytorch

Tasks

4kGPUImage MattingVideo MattingVocal Bursts Intensity Prediction

Similar Papers 제목 키워드 기반

Ultrahigh Resolution Image/Video Matting With Spatio-Temporal Sparsity

2023-01-01 · CVPR 2023 1 · Yanan sun, Chi-Keung Tang, Yu-Wing Tai

Commodity ultra-high definition (UHD) displays are becoming more affordable which demand imaging in ultra high resolution (UHR). This paper proposes SparseMat, a computationally efficient approach for UHR image/video…

Image MattingVideo Matting

Deep Video Matting via Spatio-Temporal Alignment and Aggregation

2021-04-22 · CVPR 2021 1 · Yanan sun, Guanzhi Wang, Qiao Gu, Chi-Keung Tang 외

Despite the significant progress made by deep learning in natural image matting, there has been so far no representative work on deep learning for video matting due to the inherent technical challenges in reasoning tempo…

DecoderDeep LearningImage MattingOptical Flow Estimation+1

Video Instance Matting

2023-11-07 · Jiachen Li, Roberto Henschel, Vidit Goel, Marianna Ohanyan 외

Conventional video matting outputs one alpha matte for all instances appearing in a video frame so that individual instances are not distinguished. While video instance segmentation provides time-consistent instance mask…

BinarizationImage MattingInstance SegmentationSemantic Segmentation+2

Attention-guided Temporally Coherent Video Object Matting

2021-05-24 · Yunke Zhang, Chi Wang, Miaomiao Cui, Peiran Ren 외

This paper proposes a novel deep learning-based video object matting method that can achieve temporally coherent matting results. Its key component is an attention-based temporal aggregation module that maximizes image m…

Image MattingObjectSemantic SegmentationVideo Matting+2

Real-Time High-Resolution Background Matting

2020-12-14 · CVPR 2021 1 · Shanchuan Lin, Andrey Ryabtsev, Soumyadip Sengupta, Brian Curless 외

We introduce a real-time, high-resolution background replacement technique which operates at 30fps in 4K resolution, and 60fps for HD on a modern GPU. Our technique is based on background matting, where an additional fra…

4kGPUImage MattingVocal Bursts Intensity Prediction