paper-with-me

홈 › Papers

GlyphDraw2: Automatic Generation of Complex Glyph Posters with Diffusion Models and Large Language Models

2024-07-02 · Jian Ma, Yonglin Deng, Chen Chen, Haonan Lu, Zhenyu Yang

Posters play a crucial role in marketing and advertising by enhancing visual communication and brand visibility, making significant contributions to industrial design. With the latest advancements in controllable T2I diffusion models, increasing research has focused on rendering text within synthesized images. Despite improvements in text rendering accuracy, the field of automatic poster generation remains underexplored. In this paper, we propose an automatic poster generation framework with text rendering capabilities leveraging LLMs, utilizing a triple-cross attention mechanism based on alignment learning. This framework aims to create precise poster text within a detailed contextual background. Additionally, the framework supports controllable fonts, adjustable image resolution, and the rendering of posters with descriptions and text in both English and Chinese.Furthermore, we introduce a high-resolution font dataset and a poster dataset with resolutions exceeding 1024 pixels. Our approach leverages the SDXL architecture. Extensive experiments validate our method's capability in generating poster images with complex and contextually rich backgrounds.Codes is available at https://github.com/OPPO-Mente-Lab/GlyphDraw2.

📄 PDF Abstract BibTeX arXiv:2407.02252

Code (1)

oppo-mente-lab/glyphdraw2 공식 구현 pytorch

Tasks

Marketing

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

GlyphDraw: Seamlessly Rendering Text with Intricate Spatial Structures in Text-to-Image Generation

2023-03-31 · Jian Ma, Mingjun Zhao, Chen Chen, Ruichen Wang 외

Recent breakthroughs in the field of language-guided image generation have yielded impressive achievements, enabling the creation of high-quality and diverse images based on user instructions.Although the synthesis perfo…

Image GenerationOptical Character Recognition (OCR)parameter-efficient fine-tuningText to Image Generation+1

TextRefine: Improving Textual Fidelity, Spatial Placement, and Glyph Rendering for Text Editing in Product Posters

2026-08-20 · Honglie Wang, Jia Sun, Zijun Li, Junlong Wu 외 arxiv

Text editing in product posters entails inserting new text or replacing existing text while preserving product appearance, background content, and global composition. Despite recent progress in instruction-based image ed…

Image Editing

AutoPoster: A Highly Automatic and Content-aware Design System for Advertising Poster Generation

2023-08-02 · Jinpeng Lin, Min Zhou, Ye Ma, Yifan Gao 외

Advertising posters, a form of information presentation, combine visual and linguistic modalities. Creating a poster involves multiple steps and necessitates design experience and creativity. This paper introduces AutoPo…

AttributeLayout Generation

Multi-Content GAN for Few-Shot Font Style Transfer

2017-12-01 · CVPR 2018 6 · Samaneh Azadi, Matthew Fisher, Vladimir Kim, Zhaowen Wang 외

In this work, we focus on the challenge of taking partial observations of highly-stylized text and generalizing the observations to generate unobserved glyphs in the ornamented typeface. To generate a set of multi-conten…

Font Style TransferStyle Transfer

SciPostLayout: A Dataset for Layout Analysis and Layout Generation of Scientific Posters

2024-07-29 · Shohei Tanaka, Hao Wang, Yoshitaka Ushiku

Scientific posters are used to present the contributions of scientific papers effectively in a graphical format. However, creating a well-designed poster that efficiently summarizes the core of a paper is both labor-inte…

Layout Generation