paper-with-me

홈 › Papers

Video Inpainting of Complex Scenes

2015-03-18 · Alasdair Newson, Andrés Almansa, Matthieu Fradet, Yann Gousseau, Patrick Pérez

We propose an automatic video inpainting algorithm which relies on the optimisation of a global, patch-based functional. Our algorithm is able to deal with a variety of challenging situations which naturally arise in video inpainting, such as the correct reconstruction of dynamic textures, multiple moving objects and moving background. Furthermore, we achieve this in an order of magnitude less execution time with respect to the state-of-the-art. We are also able to achieve good quality results on high definition videos. Finally, we provide specific algorithmic details to make implementation of our algorithm as easy as possible. The resulting algorithm requires no segmentation or manual input other than the definition of the inpainting mask, and can deal with a wider variety of situations than is handled by previous work. 1. Introduction. Advanced image and video editing techniques are increasingly common in the image processing and computer vision world, and are also starting to be used in media entertainment. One common and difficult task closely linked to the world of video editing is image and video " inpainting ". Generally speaking, this is the task of replacing the content of an image or video with some other content which is visually pleasing. This subject has been extensively studied in the case of images, to such an extent that commercial image inpainting products destined for the general public are available, such as Photoshop's " Content Aware fill " [1]. However, while some impressive results have been obtained in the case of videos, the subject has been studied far less extensively than image inpainting. This relative lack of research can largely be attributed to high time complexity due to the added temporal dimension. Indeed, it has only very recently become possible to produce good quality inpainting results on high definition videos, and this only in a semi-automatic manner. Nevertheless, high-quality video inpainting has many important and useful applications such as film restoration, professional post-production in cinema and video editing for personal use. For this reason, we believe that an automatic, generic video inpainting algorithm would be extremely useful for both academic and professional communities.

📄 PDF Abstract BibTeX arXiv:1503.05528

Code (0)

등록된 구현이 없습니다.

Tasks

Image InpaintingVideo EditingVideo Inpainting

Similar Papers 제목 키워드 기반

Semantic-Aware Dynamic Parameter for Video Inpainting Transformer

2023-01-01 · ICCV 2023 1 · Eunhye Lee, Jinsu Yoo, Yunjeong Yang, Sungyong Baik 외

Recent learning-based video inpainting approaches have achieved considerable progress. However, they still cannot fully utilize semantic information within the video frames and predict improper scene layout, failing …

Mixture-of-ExpertsVideo Inpainting

Raformer: Redundancy-Aware Transformer for Video Wire Inpainting

2024-04-24 · Zhong Ji, Yimu Su, Yan Zhang, Jiacheng Hou 외

Video Wire Inpainting (VWI) is a prominent application in video inpainting, aimed at flawlessly removing wires in films or TV series, offering significant time and labor savings compared to manual frame-by-frame removal.…

Video Inpainting

CIRI: Curricular Inactivation for Residue-aware One-shot Video Inpainting

2023-01-01 · ICCV 2023 1 · Weiying Zheng, Cheng Xu, Xuemiao Xu, Wenxi Liu 외

Video inpainting aims at filling in missing regions of a video. However, when dealing with dynamic scenes with camera or object movements, annotating the inpainting target becomes laborious and impractical. In this p…

Object TrackingVideo Inpainting

RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion

2024-04-10 · Jaidev Shriram, Alex Trevithick, Lingjie Liu, Ravi Ramamoorthi

We introduce RealmDreamer, a technique for generating forward-facing 3D scenes from text descriptions. Our method optimizes a 3D Gaussian Splatting representation to match complex text prompts using pretrained diffusion …

3D InpaintingScene Generation

Deep Video Inpainting Guided by Audio-Visual Self-Supervision

2023-10-11 · Kyuyeon Kim, Junsik Jung, Woo Jae Kim, Sung-Eui Yoon

Humans can easily imagine a scene from auditory information based on their prior knowledge of audio-visual events. In this paper, we mimic this innate human ability in deep learning models to improve the quality of video…

audio-visual learningVideo Inpainting