paper-with-me

홈 › Papers

Sketch-Guided Scenery Image Outpainting

2020-06-17 · Yaxiong Wang, Yunchao Wei, Xueming Qian, Li Zhu, Yi Yang

The outpainting results produced by existing approaches are often too random to meet users' requirement. In this work, we take the image outpainting one step forward by allowing users to harvest personal custom outpainting results using sketches as the guidance. To this end, we propose an encoder-decoder based network to conduct sketch-guided outpainting, where two alignment modules are adopted to impose the generated content to be realistic and consistent with the provided sketches. First, we apply a holistic alignment module to make the synthesized part be similar to the real one from the global view. Second, we reversely produce the sketches from the synthesized part and encourage them be consistent with the ground-truth ones using a sketch alignment module. In this way, the learned generator will be imposed to pay more attention to fine details and be sensitive to the guiding sketches. To our knowledge, this work is the first attempt to explore the challenging yet meaningful conditional scenery image outpainting. We conduct extensive experiments on two collected benchmarks to qualitatively and quantitatively validate the effectiveness of our approach compared with the other state-of-the-art generative models.

📄 PDF Abstract BibTeX arXiv:2006.09788

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderImage Outpainting

Similar Papers 제목 키워드 기반

ReGO: Reference-Guided Outpainting for Scenery Image

2021-06-20 · Yaxiong Wang, Yunchao Wei, Xueming Qian, Li Zhu 외

We aim to tackle the challenging yet practical scenery image outpainting task in this work. Recently, generative adversarial learning has significantly advanced the image outpainting by producing semantic consistent cont…

Image Outpainting

Very Long Natural Scenery Image Prediction by Outpainting

2019-12-29 · ICCV 2019 10 · Zongxin Yang, Jian Dong, Ping Liu, Yi Yang 외

Comparing to image inpainting, image outpainting receives less attention due to two challenges in it. The first challenge is how to keep the spatial and content consistency between generated images and original input. Th…

DecoderImage InpaintingImage OutpaintingPrediction

Generalised Image Outpainting with U-Transformer

2022-01-27 · Penglei Gao, Xi Yang, Rui Zhang, John Y. Goulermas 외

In this paper, we develop a novel transformer-based generative adversarial neural network called U-Transformer for generalised image outpainting problem. Different from most present image outpainting methods conducting h…

DecoderImage Outpainting

Continuous-Multiple Image Outpainting in One-Step via Positional Query and A Diffusion-based Approach

2024-01-28 · Shaofeng Zhang, Jinfa Huang, Qiang Zhou, Zhibin Wang 외

Image outpainting aims to generate the content of an input sub-image beyond its original boundaries. It is an important task in content generation yet remains an open problem for generative models. This paper pushes the …

Image Outpainting

VIP: Versatile Image Outpainting Empowered by Multimodal Large Language Model

2024-06-03 · Jinze Yang, Haoran Wang, Zining Zhu, Chenglong Liu 외

In this paper, we focus on resolving the problem of image outpainting, which aims to extrapolate the surrounding parts given the center contents of an image. Although recent works have achieved promising performance, the…

Image OutpaintingLanguage ModelingLanguage ModellingLarge Language Model+1