paper-with-me

Papers

RGB-D Image Inpainting Using Generative Adversarial Network with a Late Fusion Approach

2021-10-14 · Ryo Fujii, Ryo Hachiuma, Hideo Saito

Diminished reality is a technology that aims to remove objects from video images and fills in the missing region with plausible pixels. Most conventional methods utilize the different cameras that capture the same scene from different viewpoints to allow regions to be removed and restored. In this paper, we propose an RGB-D image inpainting method using generative adversarial network, which does not require multiple cameras. Recently, an RGB image inpainting method has achieved outstanding results by employing a generative adversarial network. However, RGB inpainting methods aim to restore only the texture of the missing region and, therefore, does not recover geometric information (i.e, 3D structure of the scene). We expand conventional image inpainting method to RGB-D image inpainting to jointly restore the texture and geometry of missing regions from a pair of RGB and depth images. Inspired by other tasks that use RGB and depth images (e.g., semantic segmentation and object detection), we propose late fusion approach that exploits the advantage of RGB and depth information each other. The experimental results verify the effectiveness of our proposed method.

📄 PDF Abstract BibTeX arXiv:2110.07413

Code (0)

등록된 구현이 없습니다.

Tasks

Generative Adversarial NetworkImage Inpaintingobject-detectionObject DetectionSemantic Segmentation

Methods 이 논문이 사용한 방법론

Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.

Similar Papers 제목 키워드 기반

Generative Image Inpainting with Segmentation Confusion Adversarial Training and Contrastive Learning

2023-03-23 · Zhiwen Zuo, Lei Zhao, Ailin Li, Zhizhong Wang 외

This paper presents a new adversarial training framework for image inpainting with segmentation confusion adversarial training (SCAT) and contrastive learning. SCAT plays an adversarial game between an inpainting generat…

Contrastive LearningImage Inpainting

DiffGANPaint: Fast Inpainting Using Denoising Diffusion GANs

2023-08-03 · Moein Heidari, Alireza Morsali, Tohid Abedini, Samin Heydarian

Free-form image inpainting is the task of reconstructing parts of an image specified by an arbitrary binary mask. In this task, it is typically desired to generalize model capabilities to unseen mask types, rather than l…

DenoisingGenerative Adversarial NetworkImage Inpainting

AdvPaint: Protecting Images from Inpainting Manipulation via Adversarial Attention Disruption

2025-03-13 · Joonsung Jeon, Woo Jae Kim, Suhyeon Ha, Sooel Son 외

The outstanding capability of diffusion models in generating high-quality images poses significant threats when misused by adversaries. In particular, we assume malicious adversaries exploiting diffusion models for inpai…

Image Generation

Adv-Diffusion: Imperceptible Adversarial Face Identity Attack via Latent Diffusion Model

2023-12-18 · Decheng Liu, Xijun Wang, Chunlei Peng, Nannan Wang 외

Adversarial attacks involve adding perturbations to the source image to cause misclassification by the target model, which demonstrates the potential of attacking face recognition models. Existing adversarial face image …

Image Generation

Quaternion Generative Adversarial Neural Networks and Applications to Color Image Inpainting

2024-06-17 · Duan Wang, Dandan Zhu, Meixiang Zhao, Zhigang Jia

Color image inpainting is a challenging task in imaging science. The existing method is based on real operation, and the red, green and blue channels of the color image are processed separately, ignoring the correlation …

Image Inpainting