paper-with-me

홈 › Papers

Few-shot Image Generation Using Discrete Content Representation

2022-07-22 · Yan Hong, Li Niu, Jianfu Zhang, Liqing Zhang

Few-shot image generation and few-shot image translation are two related tasks, both of which aim to generate new images for an unseen category with only a few images. In this work, we make the first attempt to adapt few-shot image translation method to few-shot image generation task. Few-shot image translation disentangles an image into style vector and content map. An unseen style vector can be combined with different seen content maps to produce different images. However, it needs to store seen images to provide content maps and the unseen style vector may be incompatible with seen content maps. To adapt it to few-shot image generation task, we learn a compact dictionary of local content vectors via quantizing continuous content maps into discrete content maps instead of storing seen images. Furthermore, we model the autoregressive distribution of discrete content map conditioned on style vector, which can alleviate the incompatibility between content map and style vector. Qualitative and quantitative results on three real datasets demonstrate that our model can produce images of higher diversity and fidelity for unseen categories than previous methods.

📄 PDF Abstract BibTeX arXiv:2207.10833

Code (0)

등록된 구현이 없습니다.

Tasks

DiversityImage GenerationTranslation

Similar Papers 제목 키워드 기반

MedUnifier: Unifying Vision-and-Language Pre-training on Medical Data with Vision Generation Task using Discrete Visual Representations

2025-03-02 · CVPR 2025 1 · Ziyang Zhang, Yang Yu, Yucheng Chen, Xulei Yang 외

Despite significant progress in Vision-Language Pre-training (VLP), current approaches predominantly emphasize feature extraction and cross-modal comprehension, with limited attention to generating or transforming visual…

image-classificationImage ClassificationImage GenerationImage-text matching+7

A unified one-shot prosody and speaker conversion system with self-supervised discrete speech units

2022-11-12 · Li-Wei Chen, Shinji Watanabe, Alexander Rudnicky

We present a unified system to realize one-shot voice conversion (VC) on the pitch, rhythm, and speaker attributes. Existing works generally ignore the correlation between prosody and language content, leading to the deg…

RhythmVoice Conversion

CF-Font: Content Fusion for Few-shot Font Generation

2023-03-24 · CVPR 2023 1 · Chi Wang, Min Zhou, Tiezheng Ge, Yuning Jiang 외

Content and style disentanglement is an effective way to achieve few-shot font generation. It allows to transfer the style of the font image in a source domain to the style defined with a few reference images in a target…

DisentanglementFont Generation

XMP-Font: Self-Supervised Cross-Modality Pre-training for Few-Shot Font Generation

2022-04-11 · CVPR 2022 1 · Wei Liu, Fangyue Liu, Fei Ding, Qian He 외

Generating a new font library is a very labor-intensive and time-consuming job for glyph-rich scripts. Few-shot font generation is thus required, as it requires only a few glyph references without fine-tuning during test…

DisentanglementFont Generation

DiFlow-TTS: Compact and Low-Latency Zero-Shot Text-to-Speech with Discrete Flow Matching

2025-09-11 · Ngoc-Son Nguyen, Thanh V. T. Tran, Hieu-Nghia Huynh-Nguyen, Truong-Son Hy 외 arxiv

Zero-shot text-to-speech (TTS) has made significant progress in replicating unseen voices, yet balancing generation quality and inference efficiency remains challenging. Autoregressive models suffer from high latency, wh…