paper-with-me

홈 › Papers

Diff-Font: Diffusion Model for Robust One-Shot Font Generation

2022-12-12 · Haibin He, Xinyuan Chen, Chaoyue Wang, Juhua Liu, Bo Du, DaCheng Tao, Yu Qiao

Font generation is a difficult and time-consuming task, especially in those languages using ideograms that have complicated structures with a large number of characters, such as Chinese. To solve this problem, few-shot font generation and even one-shot font generation have attracted a lot of attention. However, most existing font generation methods may still suffer from (i) large cross-font gap challenge; (ii) subtle cross-font variation problem; and (iii) incorrect generation of complicated characters. In this paper, we propose a novel one-shot font generation method based on a diffusion model, named Diff-Font, which can be stably trained on large datasets. The proposed model aims to generate the entire font library by giving only one sample as the reference. Specifically, a large stroke-wise dataset is constructed, and a stroke-wise diffusion model is proposed to preserve the structure and the completion of each generated character. To our best knowledge, the proposed Diff-Font is the first work that developed diffusion models to handle the font generation task. The well-trained Diff-Font is not only robust to font gap and font variation, but also achieved promising performance on difficult character generation. Compared to previous font generation methods, our model reaches state-of-the-art performance both qualitatively and quantitatively.

📄 PDF Abstract BibTeX arXiv:2212.05895

Code (1)

hxyz-123/font-diff 공식 구현 pytorch

Tasks

Font Generation

Methods 이 논문이 사용한 방법론

Library 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Generate Like Experts: Multi-Stage Font Generation by Incorporating Font Transfer Process into Diffusion Models

2024-01-01 · CVPR 2024 1 · Bin Fu, Fanghua Yu, Anran Liu, Zixuan Wang 외

Few-shot font generation (FFG) produces stylized font images with a limited number of reference samples which can significantly reduce labor costs in manual font designs. Most existing FFG methods follow the style-co…

DisentanglementFont GenerationGenerative Adversarial Network

FontDiffuser: One-Shot Font Generation via Denoising Diffusion with Multi-Scale Content Aggregation and Style Contrastive Learning

2023-12-19 · Zhenhua Yang, Dezhi Peng, Yuxin Kong, Yuyi Zhang 외

Automatic font generation is an imitation task, which aims to create a font library that mimics the style of reference images while preserving the content from source images. Although existing font generation methods hav…

Contrastive LearningDenoisingFont GenerationFont Style Transfer+2

SmartFont: Dynamic Condition Allocation for Few-Shot Font Generation

2026-06-11 · Zian Yang, Zixin Wang arxiv

Few-shot font generation simultaneously requires global structural completeness and fine-grained local style fidelity. Existing methods usually either rely on global content-style modeling, which is robust but imperfectl…

ControlText: Unlocking Controllable Fonts in Multilingual Text Rendering without Font Annotations

2025-02-16 · Bowen Jiang, Yuan Yuan, Xinyi Bai, Zhuoqun Hao 외

This work demonstrates that diffusion models can achieve font-controllable multilingual text rendering using just raw images without font label annotations. Visual text rendering remains a significant challenge. While re…

Text Segmentation

Font Style Interpolation with Diffusion Models

2024-02-22 · Tetta Kondo, Shumpei Takezaki, Daichi Haraguchi, Seiichi Uchida

Fonts have huge variations in their styles and give readers different impressions. Therefore, generating new fonts is worthy of giving new impressions to readers. In this paper, we employ diffusion models to generate new…