paper-with-me

Papers

AutoPresent: Designing Structured Visuals from Scratch

2025-01-01 · CVPR 2025 1 · Jiaxin Ge, Zora Zhiruo Wang, Xuhui Zhou, Yi-Hao Peng, Sanjay Subramanian, Qinyue Tan, Maarten Sap, Alane Suhr, Daniel Fried, Graham Neubig, Trevor Darrell

Designing structured visuals such as presentation slides is essential for communicative needs, necessitating both content creation and visual planning skills. In this work, we tackle the challenge of automated slide generation, where models produce slide presentations from natural language (NL) instructions. We first introduce the SlidesBench benchmark, the first benchmark for slide generation with 7k training and 585 testing examples derived from 310 slide decks across 10 domains. SlidesBench supports evaluations that are (i)reference-based to measure similarity to a target slide, and (ii)reference-free to measure the design quality of generated slides alone. We benchmark end-to-end image generation and program generation methods with a variety of models, and find that programmatic methods produce higher-quality slides in user-interactable formats. Built on the success of program generation, we create AutoPresent, an 8B Llama-based model trained on 7k pairs of instructions paired with code for slide generation, and achieve results comparable to the closed-source model GPT-4o. We further explore iterative design refinement where the model is tasked to self-refine its own output, and we found that this process improves the slide's quality. We hope that our work will provide a basis for future work on generating structured visuals.

📄 PDF Abstract BibTeX arXiv:2501.00912

Code (1)

para-lost/AutoPresent 공식 구현

Tasks

Image Generation

Similar Papers 제목 키워드 기반

VisualScratchpad: Inference-time Visual Concepts Analysis in Vision Language Models

2026-03-07 · Hyesu Lim, Jinho Choi, Taekyung Kim, Byeongho Heo 외 arxiv

High-performing vision language models still produce incorrect answers, yet their failure modes are often difficult to explain. To make model internals more accessible and enable systematic debugging, we introduce Visual…

VisualSem: A High-quality Knowledge Graph for Vision and Language

2020-08-20 · EMNLP (MRL) 2021 11 · Houda Alberts, Teresa Huang, Yash Deshpande, Yibo Liu 외

An exciting frontier in natural language understanding (NLU) and generation (NLG) calls for (vision-and-) language models that can efficiently access external structured knowledge repositories. However, many existing kno…

Data AugmentationNatural Language UnderstandingRetrievalVocal Bursts Intensity Prediction

Generating Gameplay-Relevant Art Assets with Transfer Learning

2020-10-04 · Adrian Gonzalez, Matthew Guzdial, Felix Ramos

In game development, designing compelling visual assets that convey gameplay-relevant features requires time and experience. Recent image generation methods that create high-quality content could reduce development costs…

Image GenerationTransfer Learning

VisualSphinx: Large-Scale Synthetic Vision Logic Puzzles for RL

2025-05-29 · Yichen Feng, Zhangchen Xu, Fengqing Jiang, Yuetai Li 외

Vision language models (VLMs) are expected to perform effective multimodal reasoning and make logically coherent decisions, which is critical to tasks such as diagram understanding and spatial problem solving. However, c…

Arithmetic ReasoningImage GenerationLogical ReasoningMultimodal Reasoning

DreamStruct: Understanding Slides and User Interfaces via Synthetic Data Generation

2024-09-30 · Yi-Hao Peng, Faria Huq, Yue Jiang, Jason Wu 외

Enabling machines to understand structured visuals like slides and user interfaces is essential for making them accessible to people with disabilities. However, achieving such understanding computationally has required m…

Code GenerationSynthetic Data Generation