Lightweight Generative Adversarial Networks for Text-Guided Image Manipulation
We propose a novel lightweight generative adversarial network for efficient image manipulation using natural language descriptions. To achieve this, a new word-level discriminator is proposed, which provides the generator with fine-grained training feedback at word-level, to facilitate training a lightweight generator that has a small number of parameters, but can still correctly focus on specific visual attributes of an image, and then edit them without affecting other contents that are not described in the text. Furthermore, thanks to the explicit training signal related to each word, the discriminator can also be simplified to have a lightweight structure. Compared with the state of the art, our method has a much smaller number of parameters, but still achieves a competitive manipulation performance. Extensive experimental results demonstrate that our method can better disentangle different visual attributes, then correctly map them to corresponding semantic words, and thus achieve a more accurate image modification using natural language descriptions.
Code (1)
Tasks
Generative Adversarial NetworkImage ManipulationText-to-Image GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
FGF-GAN: A Lightweight Generative Adversarial Network for Pansharpening via Fast Guided Filter
Pansharpening is a widely used image enhancement technique for remote sensing. Its principle is to fuse the input high-resolution single-channel panchromatic (PAN) image and low-resolution multi-spectral image and to obt…
Generative Adversarial NetworkImage EnhancementPansharpeningDAFT-GAN: Dual Affine Transformation Generative Adversarial Network for Text-Guided Image Inpainting
In recent years, there has been a significant focus on research related to text-guided image inpainting. However, the task remains challenging due to several constraints, such as ensuring alignment between the image and …
Generative Adversarial NetworkImage GenerationImage InpaintingEatGAN: An Edge-Attention Guided Generative Adversarial Network for Single Image Super-Resolution
Single-image super-resolution (SISR) is an important task in image processing, aiming to enhance the resolution of imaging systems. Recently, SISR has made a significant leap and achieved promising results with deep lear…
Image Super-ResolutionTextCLIP: Text-Guided Face Image Generation And Manipulation Without Adversarial Training
Text-guided image generation aimed to generate desired images conditioned on given texts, while text-guided image manipulation refers to semantically edit parts of a given image based on specified texts. For these two si…
Image GenerationImage Manipulationtext-guided-generationCoD-Lite: Real-Time Diffusion-Based Generative Image Compression
Recent advanced diffusion methods typically derive strong generative priors by scaling diffusion transformers. However, scaling fails to generalize when adapted for real-time compression scenarios that demand lightweight…
Image Compression