Texture Synthesis with Spatial Generative Adversarial Networks
Generative adversarial networks (GANs) are a recent approach to train generative models of data, which have been shown to work particularly well on image data. In the current paper we introduce a new model for texture synthesis based on GAN learning. By extending the input noise distribution space from a single vector to a whole spatial tensor, we create an architecture with properties well suited to the task of texture synthesis, which we call spatial GAN (SGAN). To our knowledge, this is the first successful completely data-driven texture synthesis method based on GANs. Our method has the following features which make it a state of the art algorithm for texture synthesis: high image quality of the generated textures, very high scalability w.r.t. the output texture size, fast real-time forward generation, the ability to fuse multiple diverse source images in complex textures. To illustrate these capabilities we present multiple experiments with different classes of texture images and use cases. We also discuss some limitations of our method with respect to the types of texture images it can synthesize, and compare it to other neural techniques for texture generation.
Code (3)
Tasks
Texture SynthesisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Texture Representation via Analysis and Synthesis with Generative Adversarial Networks
We investigate data-driven texture modeling via analysis and synthesis with generative adversarial networks. For network training and testing, we have compiled a diverse set of spatially homogeneous textures, ranging fro…
Texture ClassificationNon-Stationary Texture Synthesis by Adversarial Expansion
The real world exhibits an abundance of non-stationary textures. Examples include textures with large-scale structures, as well as spatially variant and inhomogeneous textures. While existing example-based texture synthe…
Generative Adversarial NetworkTexture SynthesisTexture Image Synthesis Using Spatial GAN Based on Vision Transformers
Texture synthesis is a fundamental task in computer vision, whose goal is to generate visually realistic and structurally coherent textures for a wide range of applications, from graphics to scientific simulations. While…
Generative Adversarial NetworkImage GenerationSSIMTexture SynthesisLearning Texture Manifolds with the Periodic Spatial GAN
This paper introduces a novel approach to texture synthesis based on generative adversarial networks (GAN) (Goodfellow et al., 2014). We extend the structure of the input noise distribution by constructing tensors with d…
Image GenerationTexture SynthesisPrecomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks
This paper proposes Markovian Generative Adversarial Networks (MGANs), a method for training generative neural networks for efficient texture synthesis. While deep neural network approaches have recently demonstrated rem…
Style TransferTexture Synthesis