paper-with-me

홈 › Papers

Local Padding in Patch-Based GANs for Seamless Infinite-Sized Texture Synthesis

2023-09-05 · Alhasan Abdellatif, Ahmed H. Elsheikh, Hannah P. Menke

Texture models based on Generative Adversarial Networks (GANs) use zero-padding to implicitly encode positional information of the image features. However, when extending the spatial input to generate images at large sizes, zero-padding can often lead to degradation in image quality due to the incorrect positional information at the center of the image. Moreover, zero-padding can limit the diversity within the generated large images. In this paper, we propose a novel approach for generating stochastic texture images at large arbitrary sizes using GANs based on patch-by-patch generation. Instead of zero-padding, the model uses \textit{local padding} in the generator that shares border features between the generated patches; providing positional context and ensuring consistency at the boundaries. The proposed models are trainable on a single texture image and have a constant GPU scalability with respect to the output image size, and hence can generate images of infinite sizes. We show in the experiments that our method has a significant advancement beyond existing GANs-based texture models in terms of the quality and diversity of the generated textures. Furthermore, the implementation of local padding in the state-of-the-art super-resolution models effectively eliminates tiling artifacts enabling large-scale super-resolution. Our code is available at \url{https://github.com/ai4netzero/Infinite_Texture_GANs}.

📄 PDF Abstract BibTeX arXiv:2309.02340

Code (1)

ai4netzero/infinite_texture_gans 공식 구현 pytorch

Tasks

DiversityGPUSuper-ResolutionTexture Synthesis

Similar Papers 제목 키워드 기반

CityGen: Infinite and Controllable 3D City Layout Generation

2023-12-03 · Jie Deng, Wenhao Chai, Jianshu Guo, Qixuan Huang 외

City layout generation has recently gained significant attention. The goal of this task is to automatically generate the layout of a city scene, including elements such as roads, buildings, vegetation, as well as other u…

DiversityLayout Generation

Positional Encoding as Spatial Inductive Bias in GANs

2020-12-09 · CVPR 2021 1 · Rui Xu, Xintao Wang, Kai Chen, Bolei Zhou 외

SinGAN shows impressive capability in learning internal patch distribution despite its limited effective receptive field. We are interested in knowing how such a translation-invariant convolutional generator could captur…

Image ManipulationInductive BiasTranslation

Localizing Semantic Patches for Accelerating Image Classification

2022-06-07 · Chuanguang Yang, Zhulin An, Yongjun Xu

Existing works often focus on reducing the architecture redundancy for accelerating image classification but ignore the spatial redundancy of the input image. This paper proposes an efficient image classification pipelin…

ClassificationGeneral Classificationimage-classificationImage Classification

InfinityGAN: Towards Infinite-Pixel Image Synthesis

2021-04-08 · ICLR 2022 4 · Chieh Hubert Lin, Hsin-Ying Lee, Yen-Chi Cheng, Sergey Tulyakov 외

We present a novel framework, InfinityGAN, for arbitrary-sized image generation. The task is associated with several key challenges. First, scaling existing models to an arbitrarily large image size is resource-constrain…

Image GenerationScene Generation

High-fidelity GAN Inversion with Padding Space

2022-03-21 · Qingyan Bai, Yinghao Xu, Jiapeng Zhu, Weihao Xia 외

Inverting a Generative Adversarial Network (GAN) facilitates a wide range of image editing tasks using pre-trained generators. Existing methods typically employ the latent space of GANs as the inversion space yet observe…

Generative Adversarial NetworkImage ManipulationImage Reconstruction