paper-with-me

홈 › Papers

Few-shot Image Generation via Information Transfer from the Built Geodesic Surface

2024-01-03 · Yuexing Han, Liheng Ruan, Bing Wang

Images generated by most of generative models trained with limited data often exhibit deficiencies in either fidelity, diversity, or both. One effective solution to address the limitation is few-shot generative model adaption. However, the type of approaches typically rely on a large-scale pre-trained model, serving as a source domain, to facilitate information transfer to the target domain. In this paper, we propose a method called Information Transfer from the Built Geodesic Surface (ITBGS), which contains two module: Feature Augmentation on Geodesic Surface (FAGS); Interpolation and Regularization (I\&R). With the FAGS module, a pseudo-source domain is created by projecting image features from the training dataset into the Pre-Shape Space, subsequently generating new features on the Geodesic surface. Thus, no pre-trained models is needed for the adaption process during the training of generative models with FAGS. I\&R module are introduced for supervising the interpolated images and regularizing their relative distances, respectively, to further enhance the quality of generated images. Through qualitative and quantitative experiments, we demonstrate that the proposed method consistently achieves optimal or comparable results across a diverse range of semantically distinct datasets, even in extremely few-shot scenarios.

📄 PDF Abstract BibTeX arXiv:2401.01749

Code (0)

등록된 구현이 없습니다.

Tasks

DiversityImage Generation

Similar Papers 제목 키워드 기반

Let RGB Be the Language of Vision

2026-07-14 · Timing Yang, Jinrui Yang, Xinlong Li, Yuhan Wang 외 arxiv

This work introduces a unified formulation for vision models, where diverse forms of visual information beyond natural images, such as masks, depth maps, and other structured visual signals, are all represented as RGB im…

Depth EstimationImage GenerationImage Editing

D3T-GAN: Data-Dependent Domain Transfer GANs for Few-shot Image Generation

2022-05-12 · Xintian Wu, Huanyu Wang, Yiming Wu, Xi Li

As an important and challenging problem, few-shot image generation aims at generating realistic images through training a GAN model given few samples. A typical solution for few-shot generation is to transfer a well-trai…

Image GenerationKnowledge DistillationTransfer Learning

Few-Shot Human Motion Transfer by Personalized Geometry and Texture Modeling

2021-03-26 · CVPR 2021 1 · Zhichao Huang, Xintong Han, Jia Xu, Tong Zhang

We present a new method for few-shot human motion transfer that achieves realistic human image generation with only a small number of appearance inputs. Despite recent advances in single person motion transfer, prior met…

Appearance TransferImage Generation

Progressive Ensemble Networks for Zero-Shot Recognition

2018-05-18 · CVPR 2019 6 · Meng Ye, Yuhong Guo

Despite the advancement of supervised image recognition algorithms, their dependence on the availability of labeled data and the rapid expansion of image categories raise the significant challenge of zero-shot learning. …

DiversityGeneralized Zero-Shot Learningimage-classificationImage Classification+1

Understanding Transferable Representation Learning and Zero-shot Transfer in CLIP

2023-10-02 · Zixiang Chen, Yihe Deng, Yuanzhi Li, Quanquan Gu

Multi-modal learning has become increasingly popular due to its ability to leverage information from different data sources (e.g., text and images) to improve the model performance. Recently, CLIP has emerged as an effec…

Image GenerationRepresentation LearningZero-Shot Learning