Learning Texture Manifolds with the Periodic Spatial GAN
This paper introduces a novel approach to texture synthesis based on generative adversarial networks (GAN) (Goodfellow et al., 2014). We extend the structure of the input noise distribution by constructing tensors with different types of dimensions. We call this technique Periodic Spatial GAN (PSGAN). The PSGAN has several novel abilities which surpass the current state of the art in texture synthesis. First, we can learn multiple textures from datasets of one or more complex large images. Second, we show that the image generation with PSGANs has properties of a texture manifold: we can smoothly interpolate between samples in the structured noise space and generate novel samples, which lie perceptually between the textures of the original dataset. In addition, we can also accurately learn periodical textures. We make multiple experiments which show that PSGANs can flexibly handle diverse texture and image data sources. Our method is highly scalable and it can generate output images of arbitrary large size.
Code (7)
Tasks
Image GenerationTexture SynthesisSimilar Papers 제목 키워드 기반
FunPhase: A Periodic Functional Autoencoder for Motion Generation via Phase Manifolds
Learning natural body motion remains challenging due to the strong coupling between spatial geometry and temporal dynamics. Embedding motion in phase manifolds, latent spaces that capture local periodicity, has proven ef…
Symmetric Lyapunov Subcenter Manifolds for Periodic Regulation of Mechanical Systems
Multi-body mechanical systems have rich internal dynamics, whose solutions can be exploited as energy-efficient control targets. Yet, solutions non-trivially depend on system parameters, obscuring feasible properties for…
DeepPhase: Periodic Autoencoders for Learning Motion Phase Manifolds
Learning the spatial-temporal structure of body movements is a fundamental problem for character motion synthesis. In this work, we propose a novel neural network architecture called the Periodic Autoencoder that can lea…
Motion SynthesisA geometrically aware auto-encoder for multi-texture synthesis
We propose an auto-encoder architecture for multi-texture synthesis. The approach relies on both a compact encoder accounting for second order neural statistics and a generator incorporating adaptive periodic content. Im…
Texture SynthesisSynthesis of Near-regular Natural Textures
Texture synthesis is widely used in the field of computer graphics, vision, and image processing. In the present paper, a texture synthesis algorithm is proposed for near-regular natural textures with the help of a repre…
Texture Synthesis