paper-with-me

홈 › Papers

Structure-guided Image Outpainting

2022-12-21 · Xi Wang, Weixi Cheng, Wenliang Jia

Deep learning techniques have made considerable progress in image inpainting, restoration, and reconstruction in the last few years. Image outpainting, also known as image extrapolation, lacks attention and practical approaches to be fulfilled, owing to difficulties caused by large-scale area loss and less legitimate neighboring information. These difficulties have made outpainted images handled by most of the existing models unrealistic to human eyes and spatially inconsistent. When upsampling through deconvolution to generate fake content, the naive generation methods may lead to results lacking high-frequency details and structural authenticity. Therefore, as our novelties to handle image outpainting problems, we introduce structural prior as a condition to optimize the generation quality and a new semantic embedding term to enhance perceptual sanity. we propose a deep learning method based on Generative Adversarial Network (GAN) and condition edges as structural prior in order to assist the generation. We use a multi-phase adversarial training scheme that comprises edge inference training, contents inpainting training, and joint training. The newly added semantic embedding loss is proved effective in practice.

📄 PDF Abstract BibTeX arXiv:2212.12326

Code (0)

등록된 구현이 없습니다.

Tasks

Generative Adversarial NetworkImage InpaintingImage Outpainting

Methods 이 논문이 사용한 방법론

Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.

Similar Papers 제목 키워드 기반

Sketch-Guided Scenery Image Outpainting

2020-06-17 · Yaxiong Wang, Yunchao Wei, Xueming Qian, Li Zhu 외

The outpainting results produced by existing approaches are often too random to meet users' requirement. In this work, we take the image outpainting one step forward by allowing users to harvest personal custom outpainti…

DecoderImage Outpainting

Towards Reliable Image Outpainting: Learning Structure-Aware Multimodal Fusion with Depth Guidance

2022-04-12 · Lei Zhang, Kang Liao, Chunyu Lin, Yao Zhao

Image outpainting technology generates visually plausible content regardless of authenticity, making it unreliable to be applied in practice. Thus, we propose a reliable image outpainting task, introducing the sparse dep…

Image Outpainting

Scene Graph Expansion for Semantics-Guided Image Outpainting

2022-05-05 · CVPR 2022 1 · Chiao-An Yang, Cheng-Yo Tan, Wan-Cyuan Fan, Cheng-Fu Yang 외

In this paper, we address the task of semantics-guided image outpainting, which is to complete an image by generating semantically practical content. Different from most existing image outpainting works, we approach the …

Image Outpainting

Generalised Image Outpainting with U-Transformer

2022-01-27 · Penglei Gao, Xi Yang, Rui Zhang, John Y. Goulermas 외

In this paper, we develop a novel transformer-based generative adversarial neural network called U-Transformer for generalised image outpainting problem. Different from most present image outpainting methods conducting h…

DecoderImage Outpainting

In&Out : Diverse Image Outpainting via GAN Inversion

2021-04-01 · Yen-Chi Cheng, Chieh Hubert Lin, Hsin-Ying Lee, Jian Ren 외

Image outpainting seeks for a semantically consistent extension of the input image beyond its available content. Compared to inpainting -- filling in missing pixels in a way coherent with the neighboring pixels -- outpai…

DiversityImage OutpaintingImage-to-Image TranslationTranslation