paper-with-me

홈 › Papers

Continuous and Diverse Image-to-Image Translation via Signed Attribute Vectors

2020-11-02 · Qi Mao, Hung-Yu Tseng, Hsin-Ying Lee, Jia-Bin Huang, Siwei Ma, Ming-Hsuan Yang

Recent image-to-image (I2I) translation algorithms focus on learning the mapping from a source to a target domain. However, the continuous translation problem that synthesizes intermediate results between two domains has not been well-studied in the literature. Generating a smooth sequence of intermediate results bridges the gap of two different domains, facilitating the morphing effect across domains. Existing I2I approaches are limited to either intra-domain or deterministic inter-domain continuous translation. In this work, we present an effectively signed attribute vector, which enables continuous translation on diverse mapping paths across various domains. In particular, we introduce a unified attribute space shared by all domains that utilize the sign operation to encode the domain information, thereby allowing the interpolation on attribute vectors of different domains. To enhance the visual quality of continuous translation results, we generate a trajectory between two sign-symmetrical attribute vectors and leverage the domain information of the interpolated results along the trajectory for adversarial training. We evaluate the proposed method on a wide range of I2I translation tasks. Both qualitative and quantitative results demonstrate that the proposed framework generates more high-quality continuous translation results against the state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2011.01215

Code (1)

HelenMao/SAVI2I 공식 구현 pytorch

Tasks

AttributeImage-to-Image TranslationTranslation

Similar Papers 제목 키워드 기반

LSC-GAN: Latent Style Code Modeling for Continuous Image-to-image Translation

2021-10-11 · Qiusheng Huang, Xueqi Hu, Li Sun, Qingli Li

Image-to-image (I2I) translation is usually carried out among discrete domains. However, image domains, often corresponding to a physical value, are usually continuous. In other words, images gradually change with the va…

DecoderImage-to-Image TranslationTranslation

Stochastic Actor-Executor-Critic for Image-to-Image Translation

2021-12-14 · Ziwei Luo, Jing Hu, Xin Wang, Siwei Lyu 외

Training a model-free deep reinforcement learning model to solve image-to-image translation is difficult since it involves high-dimensional continuous state and action spaces. In this paper, we draw inspiration from the …

continuous-controlContinuous ControlDeep Reinforcement LearningImage-to-Image Translation+4

MVP: Multivariate polynomials for conditional generation

2021-01-01 · Grigorios Chrysos, Yannis Panagakis

Conditional Generative Adversarial Nets (cGANs) have been widely adopted for image generation. cGANs take i) a noise vector and ii) a conditional variable as input. The conditional variable can be discrete (e.g., a clas…

Conditional Image GenerationImage GenerationImage-to-Image TranslationTranslation

Image Generation using Continuous Filter Atoms

2021-12-01 · NeurIPS 2021 12 · Ze Wang, Seunghyun Hwang, Zichen Miao, Qiang Qiu

In this paper, we model the subspace of convolutional filters with a neural ordinary differential equation (ODE) to enable gradual changes in generated images. Decomposing convolutional filters over a set of filter atoms…

Image GenerationImage-to-Image TranslationNavigateTranslation

Image-to-image Translation via Hierarchical Style Disentanglement

2021-03-02 · CVPR 2021 1 · Xinyang Li, Shengchuan Zhang, Jie Hu, Liujuan Cao 외

Recently, image-to-image translation has made significant progress in achieving both multi-label (\ie, translation conditioned on different labels) and multi-style (\ie, generation with diverse styles) tasks. However, du…

DisentanglementImage-to-Image TranslationMultimodal Unsupervised Image-To-Image TranslationTranslation