paper-with-me

Papers

IMAGINE: Image Synthesis by Image-Guided Model Inversion

2021-04-13 · CVPR 2021 1 · Pei Wang, Yijun Li, Krishna Kumar Singh, Jingwan Lu, Nuno Vasconcelos

We introduce an inversion based method, denoted as IMAge-Guided model INvErsion (IMAGINE), to generate high-quality and diverse images from only a single training sample. We leverage the knowledge of image semantics from a pre-trained classifier to achieve plausible generations via matching multi-level feature representations in the classifier, associated with adversarial training with an external discriminator. IMAGINE enables the synthesis procedure to simultaneously 1) enforce semantic specificity constraints during the synthesis, 2) produce realistic images without generator training, and 3) give users intuitive control over the generation process. With extensive experimental results, we demonstrate qualitatively and quantitatively that IMAGINE performs favorably against state-of-the-art GAN-based and inversion-based methods, across three different image domains (i.e., objects, scenes, and textures).

📄 PDF Abstract BibTeX arXiv:2104.05895

Code (0)

등록된 구현이 없습니다.

Tasks

Image GenerationmodelSpecificity

Similar Papers 제목 키워드 기반

SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations

2021-08-02 · ICLR 2022 4 · Chenlin Meng, Yutong He, Yang song, Jiaming Song 외

Guided image synthesis enables everyday users to create and edit photo-realistic images with minimum effort. The key challenge is balancing faithfulness to the user input (e.g., hand-drawn colored strokes) and realism of…

DenoisingImage Generation

Retrieval-guided Cross-view Image Synthesis

2024-11-29 · Hongji Yang, Yiru Li, Yingying Zhu

Information retrieval techniques have demonstrated exceptional capabilities in identifying semantic similarities across diverse domains through robust feature representations. However, their potential in guiding synthesi…

Contrastive LearningDiversityImage GenerationInformation Retrieval+3

An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversion

2022-08-02 · Rinon Gal, Yuval Alaluf, Yuval Atzmon, Or Patashnik 외

Text-to-image models offer unprecedented freedom to guide creation through natural language. Yet, it is unclear how such freedom can be exercised to generate images of specific unique concepts, modify their appearance, o…

Image GenerationPersonalized Image GenerationText to Image GenerationText-to-Image Generation

Noise Map Guidance: Inversion with Spatial Context for Real Image Editing

2024-02-07 · Hansam Cho, Jonghyun Lee, Seoung Bum Kim, Tae-Hyun Oh 외

Text-guided diffusion models have become a popular tool in image synthesis, known for producing high-quality and diverse images. However, their application to editing real images often encounters hurdles primarily due to…

Image Generation

TediGAN: Text-Guided Diverse Face Image Generation and Manipulation

2020-12-06 · CVPR 2021 1 · Weihao Xia, Yujiu Yang, Jing-Hao Xue, Baoyuan Wu

In this work, we propose TediGAN, a novel framework for multi-modal image generation and manipulation with textual descriptions. The proposed method consists of three components: StyleGAN inversion module, visual-linguis…

Face Sketch SynthesisImage GenerationText-to-Image Generation