paper-with-me

홈 › Papers

Internal Video Inpainting by Implicit Long-range Propagation

2021-08-04 · ICCV 2021 10 · Hao Ouyang, Tengfei Wang, Qifeng Chen

We propose a novel framework for video inpainting by adopting an internal learning strategy. Unlike previous methods that use optical flow for cross-frame context propagation to inpaint unknown regions, we show that this can be achieved implicitly by fitting a convolutional neural network to known regions. Moreover, to handle challenging sequences with ambiguous backgrounds or long-term occlusion, we design two regularization terms to preserve high-frequency details and long-term temporal consistency. Extensive experiments on the DAVIS dataset demonstrate that the proposed method achieves state-of-the-art inpainting quality quantitatively and qualitatively. We further extend the proposed method to another challenging task: learning to remove an object from a video giving a single object mask in only one frame in a 4K video.

📄 PDF Abstract BibTeX arXiv:2108.01912

Code (1)

Tengfei-Wang/Implicit-Internal-Video-Inpainting 공식 구현 tf

Tasks

4kObjectOptical Flow EstimationVideo Inpainting

Methods 이 논문이 사용한 방법론

Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.

Similar Papers 제목 키워드 기반

An Internal Learning Approach to Video Inpainting

2019-09-17 · ICCV 2019 10 · Haotian Zhang, Long Mai, Ning Xu, Zhaowen Wang 외

We propose a novel video inpainting algorithm that simultaneously hallucinates missing appearance and motion (optical flow) information, building upon the recent 'Deep Image Prior' (DIP) that exploits convolutional netwo…

Optical Flow EstimationVideo Inpainting

Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoising

2025-11-05 · Shuangquan Lyu, Steven Mao, Yue Ma arxiv

Generating long videos remains a fundamental challenge, and achieving high controllability in video inpainting and outpainting is particularly demanding. To address both of these challenges simultaneously and achieve con…

Video GenerationVideo Inpainting

HNeRV: A Hybrid Neural Representation for Videos

2023-04-05 · CVPR 2023 1 · Hao Chen, Matt Gwilliam, Ser-Nam Lim, Abhinav Shrivastava

Implicit neural representations store videos as neural networks and have performed well for various vision tasks such as video compression and denoising. With frame index or positional index as input, implicit representa…

DecoderDenoisingregressionVideo Compression+2

Attentive Normalization for Conditional Image Generation

2020-04-08 · CVPR 2020 6 · Yi Wang, Ying-Cong Chen, Xiangyu Zhang, Jian Sun 외

Traditional convolution-based generative adversarial networks synthesize images based on hierarchical local operations, where long-range dependency relation is implicitly modeled with a Markov chain. It is still not suff…

Conditional Image GenerationImage GenerationSemantic correspondenceSemantic Similarity+1

Infusion: internal diffusion for inpainting of dynamic textures and complex motion

2023-11-02 · Nicolas Cherel, Andrés Almansa, Yann Gousseau, Alasdair Newson

Video inpainting is the task of filling a region in a video in a visually convincing manner. It is very challenging due to the high dimensionality of the data and the temporal consistency required for obtaining convincin…

Image InpaintingOptical Flow EstimationVideo Inpainting