paper-with-me

홈 › Papers

LatentAugment: Data Augmentation via Guided Manipulation of GAN's Latent Space

2023-07-21 · Lorenzo Tronchin, Minh H. Vu, Paolo Soda, Tommy Löfstedt

Data Augmentation (DA) is a technique to increase the quantity and diversity of the training data, and by that alleviate overfitting and improve generalisation. However, standard DA produces synthetic data for augmentation with limited diversity. Generative Adversarial Networks (GANs) may unlock additional information in a dataset by generating synthetic samples having the appearance of real images. However, these models struggle to simultaneously address three key requirements: fidelity and high-quality samples; diversity and mode coverage; and fast sampling. Indeed, GANs generate high-quality samples rapidly, but have poor mode coverage, limiting their adoption in DA applications. We propose LatentAugment, a DA strategy that overcomes the low diversity of GANs, opening up for use in DA applications. Without external supervision, LatentAugment modifies latent vectors and moves them into latent space regions to maximise the synthetic images' diversity and fidelity. It is also agnostic to the dataset and the downstream task. A wide set of experiments shows that LatentAugment improves the generalisation of a deep model translating from MRI-to-CT beating both standard DA as well GAN-based sampling. Moreover, still in comparison with GAN-based sampling, LatentAugment synthetic samples show superior mode coverage and diversity. Code is available at: https://github.com/ltronchin/LatentAugment.

📄 PDF Abstract BibTeX arXiv:2307.11375

Code (1)

ltronchin/latentaugment 공식 구현 pytorch

Tasks

Data AugmentationDiversity

Similar Papers 제목 키워드 기반

LatentAugment: Dynamically Optimized Latent Probabilities of Data Augmentation

2023-05-04 · Koichi Kuriyama

Although data augmentation is a powerful technique for improving the performance of image classification tasks, it is difficult to identify the best augmentation policy. The optimal augmentation policy, which is the late…

Data Augmentationimage-classificationImage Classification

CLIP-PAE: Projection-Augmentation Embedding to Extract Relevant Features for a Disentangled, Interpretable, and Controllable Text-Guided Face Manipulation

2022-10-08 · Chenliang Zhou, Fangcheng Zhong, Cengiz Oztireli

Recently introduced Contrastive Language-Image Pre-Training (CLIP) bridges images and text by embedding them into a joint latent space. This opens the door to ample literature that aims to manipulate an input image by pr…

DisentanglementImage Manipulation

LDEdit: Towards Generalized Text Guided Image Manipulation via Latent Diffusion Models

2022-10-05 · Paramanand Chandramouli, Kanchana Vaishnavi Gandikota

Research in vision-language models has seen rapid developments off-late, enabling natural language-based interfaces for image generation and manipulation. Many existing text guided manipulation techniques are restricted …

Image GenerationImage ManipulationStyle TransferText to Image Generation+1

Prompt Augmentation for Self-supervised Text-guided Image Manipulation

2024-12-17 · CVPR 2024 1 · Rumeysa Bodur, Binod Bhattarai, Tae-Kyun Kim

Text-guided image editing finds applications in various creative and practical fields. While recent studies in image generation have advanced the field, they often struggle with the dual challenges of coherent image tran…

Image GenerationImage Manipulationtext-guided-image-editing

Towards Open-World Text-Guided Face Image Generation and Manipulation

2021-04-18 · Weihao Xia, Yujiu Yang, Jing-Hao Xue, Baoyuan Wu

The existing text-guided image synthesis methods can only produce limited quality results with at most \mbox{$\text{256}^2$} resolution and the textual instructions are constrained in a small Corpus. In this work, we pro…

Image GenerationLanguage ModellingSemantic SegmentationText-to-Image Generation