paper-with-me

홈 › Papers

Extreme Face Inpainting with Sketch-Guided Conditional GAN

2021-05-13 · Nilesh Pandey, Andreas Savakis

Recovering badly damaged face images is a useful yet challenging task, especially in extreme cases where the masked or damaged region is very large. One of the major challenges is the ability of the system to generalize on faces outside the training dataset. We propose to tackle this extreme inpainting task with a conditional Generative Adversarial Network (GAN) that utilizes structural information, such as edges, as a prior condition. Edge information can be obtained from the partially masked image and a structurally similar image or a hand drawing. In our proposed conditional GAN, we pass the conditional input in every layer of the encoder while maintaining consistency in the distributions between the learned weights and the incoming conditional input. We demonstrate the effectiveness of our method with badly damaged face examples.

📄 PDF Abstract BibTeX arXiv:2105.06033

Code (0)

등록된 구현이 없습니다.

Tasks

Facial InpaintingGenerative Adversarial Network

Methods 이 논문이 사용한 방법론

Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.

Similar Papers 제목 키워드 기반

Sketch-guided Image Inpainting with Partial Discrete Diffusion Process

2024-04-18 · Nakul Sharma, Aditay Tripathi, Anirban Chakraborty, Anand Mishra

In this work, we study the task of sketch-guided image inpainting. Unlike the well-explored natural language-guided image inpainting, which excels in capturing semantic details, the relatively less-studied sketch-guided …

Image Inpainting

Reference-guided Face Component Editing

2020-06-03 · Qiyao Deng, Jie Cao, Yunfan Liu, Zhenhua Chai 외

Face portrait editing has achieved great progress in recent years. However, previous methods either 1) operate on pre-defined face attributes, lacking the flexibility of controlling shapes of high-level semantic facial c…

Image Inpainting

SketchFFusion: Sketch-guided image editing with diffusion model

2023-04-06 · Weihang Mao, Bo Han, ZiHao Wang

Sketch-guided image editing aims to achieve local fine-tuning of the image based on the sketch information provided by the user, while maintaining the original status of the unedited areas. Due to the high cost of acquir…

model

AIM 2020 Challenge on Image Extreme Inpainting

2020-10-02 · Evangelos Ntavelis, Andrés Romero, Siavash Bigdeli, Radu Timofte

This paper reviews the AIM 2020 challenge on extreme image inpainting. This report focuses on proposed solutions and results for two different tracks on extreme image inpainting: classical image inpainting and semantical…

Image InpaintingSemantic Segmentation

Towards Interactive Image Inpainting via Sketch Refinement

2023-06-01 · Chang Liu, Shunxin Xu, Jialun Peng, Kaidong Zhang 외

One tough problem of image inpainting is to restore complex structures in the corrupted regions. It motivates interactive image inpainting which leverages additional hints, e.g., sketches, to assist the inpainting proces…

Image Inpainting