paper-with-me

홈 › Papers

Noise Doesn't Lie: Towards Universal Detection of Deep Inpainting

2021-06-03 · Ang Li, Qiuhong Ke, Xingjun Ma, Haiqin Weng, Zhiyuan Zong, Feng Xue, Rui Zhang

Deep image inpainting aims to restore damaged or missing regions in an image with realistic contents. While having a wide range of applications such as object removal and image recovery, deep inpainting techniques also have the risk of being manipulated for image forgery. A promising countermeasure against such forgeries is deep inpainting detection, which aims to locate the inpainted regions in an image. In this paper, we make the first attempt towards universal detection of deep inpainting, where the detection network can generalize well when detecting different deep inpainting methods. To this end, we first propose a novel data generation approach to generate a universal training dataset, which imitates the noise discrepancies exist in real versus inpainted image contents to train universal detectors. We then design a Noise-Image Cross-fusion Network (NIX-Net) to effectively exploit the discriminative information contained in both the images and their noise patterns. We empirically show, on multiple benchmark datasets, that our approach outperforms existing detection methods by a large margin and generalize well to unseen deep inpainting techniques. Our universal training dataset can also significantly boost the generalizability of existing detection methods.

📄 PDF Abstract BibTeX arXiv:2106.01532

Code (0)

등록된 구현이 없습니다.

Tasks

Image Inpainting

Methods 이 논문이 사용한 방법론

Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.

Similar Papers 제목 키워드 기반

Enhanced Wavelet Scattering Network for image inpainting detection

2024-09-25 · Barglazan Adrian-Alin, Brad Remus

The rapid advancement of image inpainting tools, especially those aimed at removing artifacts, has made digital image manipulation alarmingly accessible. This paper proposes several innovative ideas for detecting inpaint…

Image InpaintingImage ManipulationTexture Classification

Wavelet based inpainting detection

2024-08-12 · Barglazan Adrian-Alin, Brad Remus Ovidiu

With the advancement in image editing tools, manipulating digital images has become alarmingly easy. Inpainting, which is used to remove objects or fill in parts of an image, serves as a powerful tool for both image rest…

Image InpaintingImage RestorationImage SegmentationSemantic Segmentation

Image Inpainting Using Wasserstein Generative Adversarial Imputation Network

2021-06-23 · Daniel Vašata, Tomáš Halama, Magda Friedjungová

Image inpainting is one of the important tasks in computer vision which focuses on the reconstruction of missing regions in an image. The aim of this paper is to introduce an image inpainting model based on Wasserstein G…

Image InpaintingImputation

RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion

2024-04-10 · Jaidev Shriram, Alex Trevithick, Lingjie Liu, Ravi Ramamoorthi

We introduce RealmDreamer, a technique for generating forward-facing 3D scenes from text descriptions. Our method optimizes a 3D Gaussian Splatting representation to match complex text prompts using pretrained diffusion …

3D InpaintingScene Generation

UMMAFormer: A Universal Multimodal-adaptive Transformer Framework for Temporal Forgery Localization

2023-08-28 · Rui Zhang, Hongxia Wang, Mingshan Du, Hanqing Liu 외

The emergence of artificial intelligence-generated content (AIGC) has raised concerns about the authenticity of multimedia content in various fields. However, existing research for forgery content detection has focused m…

Binary ClassificationTemporal Forgery LocalizationVideo Inpainting