paper-with-me

홈 › Papers

Reimagining Reality: A Comprehensive Survey of Video Inpainting Techniques

2024-01-31 · Shreyank N Gowda, Yash Thakre, Shashank Narayana Gowda, Xiaobo Jin

This paper offers a comprehensive analysis of recent advancements in video inpainting techniques, a critical subset of computer vision and artificial intelligence. As a process that restores or fills in missing or corrupted portions of video sequences with plausible content, video inpainting has evolved significantly with the advent of deep learning methodologies. Despite the plethora of existing methods and their swift development, the landscape remains complex, posing challenges to both novices and established researchers. Our study deconstructs major techniques, their underpinning theories, and their effective applications. Moreover, we conduct an exhaustive comparative study, centering on two often-overlooked dimensions: visual quality and computational efficiency. We adopt a human-centric approach to assess visual quality, enlisting a panel of annotators to evaluate the output of different video inpainting techniques. This provides a nuanced qualitative understanding that complements traditional quantitative metrics. Concurrently, we delve into the computational aspects, comparing inference times and memory demands across a standardized hardware setup. This analysis underscores the balance between quality and efficiency: a critical consideration for practical applications where resources may be constrained. By integrating human validation and computational resource comparison, this survey not only clarifies the present landscape of video inpainting techniques but also charts a course for future explorations in this vibrant and evolving field.

📄 PDF Abstract BibTeX arXiv:2401.17883

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencySurveyVideo Inpainting

Methods 이 논문이 사용한 방법론

Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.

Similar Papers 제목 키워드 기반

Optimised ProPainter for Video Diminished Reality Inpainting

2024-06-04 · Pengze Li, Lihao Liu, Carola-Bibiane Schönlieb, Angelica I Aviles-Rivero

In this paper, part of the DREAMING Challenge - Diminished Reality for Emerging Applications in Medicine through Inpainting, we introduce a refined video inpainting technique optimised from the ProPainter method to meet …

Video Inpainting

Deep Learning-based Image and Video Inpainting: A Survey

2024-01-07 · Weize Quan, Jiaxi Chen, Yanli Liu, Dong-Ming Yan 외

Image and video inpainting is a classic problem in computer vision and computer graphics, aiming to fill in the plausible and realistic content in the missing areas of images and videos. With the advance of deep learning…

Deep LearningSurveyVideo Inpainting

A Real-Time Diminished Reality Approach to Privacy in MR Collaboration

2025-08-21 · Christian Fane arxiv

Diminished reality (DR) refers to the digital removal of real-world objects by compositing background content in their place. This thesis presents a real-time, inpainting-based DR system designed to enable privacy contro…

Semantic SegmentationObject DetectionVideo Inpainting

Towards Language-Driven Video Inpainting via Multimodal Large Language Models

2024-01-18 · CVPR 2024 1 · Jianzong Wu, Xiangtai Li, Chenyang Si, Shangchen Zhou 외

We introduce a new task -- language-driven video inpainting, which uses natural language instructions to guide the inpainting process. This approach overcomes the limitations of traditional video inpainting methods that …

Video Inpainting

Quality Assessment of DIBR-synthesized views: An Overview

2019-11-16 · Shishun Tian, Lu Zhang, Wenbin Zou, Xia Li 외

The Depth-Image-Based-Rendering (DIBR) is one of the main fundamental technique to generate new views in 3D video applications, such as Multi-View Videos (MVV), Free-Viewpoint Videos (FVV) and Virtual Reality (VR). Howev…

Survey