paper-with-me

홈 › Papers

DG-Font: Deformable Generative Networks for Unsupervised Font Generation

2021-04-07 · CVPR 2021 1 · Yangchen Xie, Xinyuan Chen, Li Sun, Yue Lu

Font generation is a challenging problem especially for some writing systems that consist of a large number of characters and has attracted a lot of attention in recent years. However, existing methods for font generation are often in supervised learning. They require a large number of paired data, which is labor-intensive and expensive to collect. Besides, common image-to-image translation models often define style as the set of textures and colors, which cannot be directly applied to font generation. To address these problems, we propose novel deformable generative networks for unsupervised font generation (DGFont). We introduce a feature deformation skip connection (FDSC) which predicts pairs of displacement maps and employs the predicted maps to apply deformable convolution to the low-level feature maps from the content encoder. The outputs of FDSC are fed into a mixer to generate the final results. Taking advantage of FDSC, the mixer outputs a high-quality character with a complete structure. To further improve the quality of generated images, we use three deformable convolution layers in the content encoder to learn style-invariant feature representations. Experiments demonstrate that our model generates characters in higher quality than state-of-art methods. The source code is available at https://github.com/ecnuycxie/DG-Font.

📄 PDF Abstract BibTeX arXiv:2104.03064

Code (1)

ecnuycxie/DG-Font 공식 구현 pytorch

Tasks

Font GenerationImage-to-Image Translation

Methods 이 논문이 사용한 방법론

Deformable Convolution Deformable convolutions add 2D offsets to the regular grid sampling locations in the standard convolution. It enables free…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

DGFont++: Robust Deformable Generative Networks for Unsupervised Font Generation

2022-12-30 · Xinyuan Chen, Yangchen Xie, Li Sun, Yue Lu

Automatic font generation without human experts is a practical and significant problem, especially for some languages that consist of a large number of characters. Existing methods for font generation are often in superv…

Font GenerationImage-to-Image TranslationSelf-Supervised LearningUnsupervised Image-To-Image Translation

Generate Like Experts: Multi-Stage Font Generation by Incorporating Font Transfer Process into Diffusion Models

2024-01-01 · CVPR 2024 1 · Bin Fu, Fanghua Yu, Anran Liu, Zixuan Wang 외

Few-shot font generation (FFG) produces stylized font images with a limited number of reference samples which can significantly reduce labor costs in manual font designs. Most existing FFG methods follow the style-co…

DisentanglementFont GenerationGenerative Adversarial Network

GenText: Unsupervised Artistic Text Generation via Decoupled Font and Texture Manipulation

2022-07-20 · Qirui Huang, Bin Fu, Aozhong zhang, Yu Qiao

Automatic artistic text generation is an emerging topic which receives increasing attention due to its wide applications. The artistic text can be divided into three components, content, font, and texture, respectively. …

Style TransferText GenerationText Style Transfer

AdaptiFont: Increasing Individuals' Reading Speed with a Generative Font Model and Bayesian Optimization

2021-04-21 · Florian Kadner, Yannik Keller, Constantin A. Rothkopf

Digital text has become one of the primary ways of exchanging knowledge, but text needs to be rendered to a screen to be read. We present AdaptiFont, a human-in-the-loop system that is aimed at interactively increasing r…

Active LearningBayesian OptimizationFont Generation

Learning Perceptual Manifold of Fonts

2021-06-17 · Haoran Xie, Yuki Fujita, Kazunori Miyata

Along the rapid development of deep learning techniques in generative models, it is becoming an urgent issue to combine machine intelligence with human intelligence to solve the practical applications. Motivated by this …

Font Generation