paper-with-me

홈 › Papers

Deep Learning-based Image and Video Inpainting: A Survey

2024-01-07 · Weize Quan, Jiaxi Chen, Yanli Liu, Dong-Ming Yan, Peter Wonka

Image and video inpainting is a classic problem in computer vision and computer graphics, aiming to fill in the plausible and realistic content in the missing areas of images and videos. With the advance of deep learning, this problem has achieved significant progress recently. The goal of this paper is to comprehensively review the deep learning-based methods for image and video inpainting. Specifically, we sort existing methods into different categories from the perspective of their high-level inpainting pipeline, present different deep learning architectures, including CNN, VAE, GAN, diffusion models, etc., and summarize techniques for module design. We review the training objectives and the common benchmark datasets. We present evaluation metrics for low-level pixel and high-level perceptional similarity, conduct a performance evaluation, and discuss the strengths and weaknesses of representative inpainting methods. We also discuss related real-world applications. Finally, we discuss open challenges and suggest potential future research directions.

📄 PDF Abstract BibTeX arXiv:2401.03395

Code (0)

등록된 구현이 없습니다.

Tasks

Deep LearningSurveyVideo Inpainting

Methods 이 논문이 사용한 방법론

Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Reimagining Reality: A Comprehensive Survey of Video Inpainting Techniques

2024-01-31 · Shreyank N Gowda, Yash Thakre, Shashank Narayana Gowda, Xiaobo Jin

This paper offers a comprehensive analysis of recent advancements in video inpainting techniques, a critical subset of computer vision and artificial intelligence. As a process that restores or fills in missing or corrup…

Computational EfficiencySurveyVideo Inpainting

Video Inpainting of Complex Scenes

2015-03-18 · Alasdair Newson, Andrés Almansa, Matthieu Fradet, Yann Gousseau 외

We propose an automatic video inpainting algorithm which relies on the optimisation of a global, patch-based functional. Our algorithm is able to deal with a variety of challenging situations which naturally arise in vid…

Image InpaintingVideo EditingVideo Inpainting

Deep Video Inpainting

2019-05-05 · CVPR 2019 6 · Dahun Kim, Sanghyun Woo, Joon-Young Lee, In So Kweon

Video inpainting aims to fill spatio-temporal holes with plausible content in a video. Despite tremendous progress of deep neural networks for image inpainting, it is challenging to extend these methods to the video doma…

DecoderImage InpaintingOptical Flow EstimationVideo Denoising+2

MTV-Inpaint: Multi-Task Long Video Inpainting

2025-03-14 · Shiyuan Yang, Zheng Gu, Liang Hou, Xin Tao 외

Video inpainting involves modifying local regions within a video, ensuring spatial and temporal consistency. Most existing methods focus primarily on scene completion (i.e., filling missing regions) and lack the capabili…

Image InpaintingObjectVideo Inpainting

Free-form Video Inpainting with 3D Gated Convolution and Temporal PatchGAN

2019-04-23 · ICCV 2019 10 · Ya-Liang Chang, Zhe Yu Liu, Kuan-Ying Lee, Winston Hsu

Free-form video inpainting is a very challenging task that could be widely used for video editing such as text removal. Existing patch-based methods could not handle non-repetitive structures such as faces, while directl…

FormVideo EditingVideo Inpainting