Continuous and Diverse Image-to-Image Translation via Signed Attribute Vectors
Recent image-to-image (I2I) translation algorithms focus on learning the mapping from a source to a target domain. However, the continuous translation problem that synthesizes intermediate results between two domains has not been well-studied in the literature. Generating a smooth sequence of intermediate results bridges the gap of two different domains, facilitating the morphing effect across domains. Existing I2I approaches are limited to either intra-domain or deterministic inter-domain continuous translation. In this work, we present an effectively signed attribute vector, which enables continuous translation on diverse mapping paths across various domains. In particular, we introduce a unified attribute space shared by all domains that utilize the sign operation to encode the domain information, thereby allowing the interpolation on attribute vectors of different domains. To enhance the visual quality of continuous translation results, we generate a trajectory between two sign-symmetrical attribute vectors and leverage the domain information of the interpolated results along the trajectory for adversarial training. We evaluate the proposed method on a wide range of I2I translation tasks. Both qualitative and quantitative results demonstrate that the proposed framework generates more high-quality continuous translation results against the state-of-the-art methods.
Code (1)
Tasks
AttributeImage-to-Image TranslationTranslationSimilar Papers 제목 키워드 기반
LSC-GAN: Latent Style Code Modeling for Continuous Image-to-image Translation
Image-to-image (I2I) translation is usually carried out among discrete domains. However, image domains, often corresponding to a physical value, are usually continuous. In other words, images gradually change with the va…
DecoderImage-to-Image TranslationTranslationStochastic Actor-Executor-Critic for Image-to-Image Translation
Training a model-free deep reinforcement learning model to solve image-to-image translation is difficult since it involves high-dimensional continuous state and action spaces. In this paper, we draw inspiration from the …
continuous-controlContinuous ControlDeep Reinforcement LearningImage-to-Image Translation+4MVP: Multivariate polynomials for conditional generation
Conditional Generative Adversarial Nets (cGANs) have been widely adopted for image generation. cGANs take i) a noise vector and ii) a conditional variable as input. The conditional variable can be discrete (e.g., a clas…
Conditional Image GenerationImage GenerationImage-to-Image TranslationTranslationImage Generation using Continuous Filter Atoms
In this paper, we model the subspace of convolutional filters with a neural ordinary differential equation (ODE) to enable gradual changes in generated images. Decomposing convolutional filters over a set of filter atoms…
Image GenerationImage-to-Image TranslationNavigateTranslationImage-to-image Translation via Hierarchical Style Disentanglement
Recently, image-to-image translation has made significant progress in achieving both multi-label (\ie, translation conditioned on different labels) and multi-style (\ie, generation with diverse styles) tasks. However, du…
DisentanglementImage-to-Image TranslationMultimodal Unsupervised Image-To-Image TranslationTranslation