paper-with-me

홈 › Papers

VDOR: A Video-based Dataset for Object Removal via Sequence Consistency

2025-01-13 · Runpu Wei, Shuo Zhang, Zhonghao Yan, Zijin Yin, Xueyi Wang, Kongming Liang, Zhanyu Ma

Object removal, as a sub-task of image inpainting, has garnered significant attention in recent years. Existing datasets related to object removal serve a valuable foundation for model validation and optimization. However, they mainly rely on inpainting techniques to generate pseudo-removed results, leading to distribution gaps between synthetic and real-world data. While some real-world datasets mitigate these issues, they face challenges such as limited scalability, high annotation costs, and unrealistic representations of lighting and shadows. To address these limitations, we propose a novel video-based annotation pipeline for constructing a realistic illumination-aware object removal dataset. Leveraging this pipeline, we introduce VDOR, a dataset specifically designed for object removal tasks, which comprises triplets of original frame images with objects, background images without objects, and corresponding masks. By leveraging continuous real-world video frames, we minimize distribution gaps and accurately capture realistic lighting and shadow variations, ensuring close alignment with real-world scenarios. Our approach significantly reduces annotation effort while providing a robust foundation for advancing object removal research.

📄 PDF Abstract BibTeX arXiv:2501.07397

Code (0)

등록된 구현이 없습니다.

Tasks

Image InpaintingObject

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…
Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.

Similar Papers 제목 키워드 기반

VORNet: Spatio-temporally Consistent Video Inpainting for Object Removal

2019-04-14 · Ya-Liang Chang, Zhe Yu Liu, Winston Hsu

Video object removal is a challenging task in video processing that often requires massive human efforts. Given the mask of the foreground object in each frame, the goal is to complete (inpaint) the object region and gen…

Image InpaintingObjectOne-shot visual object segmentationOptical Flow Estimation+3

EffectErase: Joint Video Object Removal and Insertion for High-Quality Effect Erasing

2026-03-19 · Yang Fu, Yike Zheng, Ziyun Dai, Henghui Ding arxiv

Video object removal aims to eliminate dynamic target objects and their visual effects, such as deformation, shadows, and reflections, while restoring seamless backgrounds. Recent diffusion-based video inpainting and obj…

Video Inpainting

Video Dynamics Prior: An Internal Learning Approach for Robust Video Enhancements

2023-12-13 · NeurIPS 2023 11 · Gaurav Shrivastava, Ser-Nam Lim, Abhinav Shrivastava

In this paper, we present a novel robust framework for low-level vision tasks, including denoising, object removal, frame interpolation, and super-resolution, that does not require any external training data corpus. Our …

DenoisingSuper-Resolution

VOID: Video Object and Interaction Deletion

2026-04-02 · Saman Motamed, William Harvey, Benjamin Klein, Luc Van Gool 외 arxiv

Existing video object removal methods excel at inpainting content "behind" the object and correcting appearance-level artifacts such as shadows and reflections. However, when the removed object has more significant inter…

VIP: Video Inpainting Pipeline for Real World Human Removal

2025-04-03 · Huiming Sun, Yikang Li, Kangning Yang, Ruineng Li 외

Inpainting for real-world human and pedestrian removal in high-resolution video clips presents significant challenges, particularly in achieving high-quality outcomes, ensuring temporal consistency, and managing complex …

DenoisingVideo Inpainting