paper-with-me

Papers

S2ST: Image-to-Image Translation in the Seed Space of Latent Diffusion

2023-11-30 · Or Greenberg, Eran Kishon, Dani Lischinski

Image-to-image translation (I2IT) refers to the process of transforming images from a source domain to a target domain while maintaining a fundamental connection in terms of image content. In the past few years, remarkable advancements in I2IT were achieved by Generative Adversarial Networks (GANs), which nevertheless struggle with translations requiring high precision. Recently, Diffusion Models have established themselves as the engine of choice for image generation. In this paper we introduce S2ST, a novel framework designed to accomplish global I2IT in complex photorealistic images, such as day-to-night or clear-to-rain translations of automotive scenes. S2ST operates within the seed space of a Latent Diffusion Model, thereby leveraging the powerful image priors learned by the latter. We show that S2ST surpasses state-of-the-art GAN-based I2IT methods, as well as diffusion-based approaches, for complex automotive scenes, improving fidelity while respecting the target domain's appearance across a variety of domains. Notably, S2ST obviates the necessity for training domain-specific translation networks.

📄 PDF Abstract BibTeX arXiv:2312.00116

Code (0)

등록된 구현이 없습니다.

Tasks

Image GenerationImage-to-Image TranslationTranslation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Latent Diffusion Model Diffusion models applied to latent spaces, which are normally built with (Variational) Autoencoders.

Similar Papers 제목 키워드 기반

Seed-to-Seed: Image Translation in Diffusion Seed Space

2024-09-01 · Or Greenberg, Eran Kishon, Dani Lischinski

We introduce Seed-to-Seed Translation (StS), a novel approach for Image-to-Image Translation using diffusion models (DMs), aimed at translations that require close adherence to the structure of the source image. In contr…

Image-to-Image TranslationSTSTranslation

Norm-guided latent space exploration for text-to-image generation

2023-06-14 · NeurIPS 2023 11 · Dvir Samuel, Rami Ben-Ari, Nir Darshan, Haggai Maron 외

Text-to-image diffusion models show great potential in synthesizing a large variety of concepts in new compositions and scenarios. However, the latent space of initial seeds is still not well understood and its structure…

Image GenerationLong-tail LearningText to Image GenerationText-to-Image Generation

Memories of Forgotten Concepts

2024-12-01 · CVPR 2025 1 · Matan Rusanovsky, Shimon Malnick, Amir Jevnisek, Ohad Fried 외

Diffusion models dominate the space of text-to-image generation, yet they may produce undesirable outputs, including explicit content or private data. To mitigate this, concept ablation techniques have been explored to l…

Image GenerationText to Image GenerationText-to-Image Generation

Unpaired Image-to-Image Translation via Latent Energy Transport

2020-12-01 · CVPR 2021 1 · Yang Zhao, Changyou Chen

Image-to-image translation aims to preserve source contents while translating to discriminative target styles between two visual domains. Most works apply adversarial learning in the ambient image space, which could be c…

Image ReconstructionImage-to-Image TranslationTranslation

Smoothing the Disentangled Latent Style Space for Unsupervised Image-to-Image Translation

2021-06-16 · CVPR 2021 1 · Yahui Liu, Enver Sangineto, Yajing Chen, Linchao Bao 외

Image-to-Image (I2I) multi-domain translation models are usually evaluated also using the quality of their semantic interpolation results. However, state-of-the-art models frequently show abrupt changes in the image appe…

Image-to-Image TranslationTranslationUnsupervised Image-To-Image Translation