paper-with-me

홈 › Papers

From Text to Visuals: Using LLMs to Generate Math Diagrams with Vector Graphics

2025-03-10 · Jaewook Lee, Jeongah Lee, Wanyong Feng, Andrew Lan

Advances in large language models (LLMs) offer new possibilities for enhancing math education by automating support for both teachers and students. While prior work has focused on generating math problems and high-quality distractors, the role of visualization in math learning remains under-explored. Diagrams are essential for mathematical thinking and problem-solving, yet manually creating them is time-consuming and requires domain-specific expertise, limiting scalability. Recent research on using LLMs to generate Scalable Vector Graphics (SVG) presents a promising approach to automating diagram creation. Unlike pixel-based images, SVGs represent geometric figures using XML, allowing seamless scaling and adaptability. Educational platforms such as Khan Academy and IXL already use SVGs to display math problems and hints. In this paper, we explore the use of LLMs to generate math-related diagrams that accompany textual hints via intermediate SVG representations. We address three research questions: (1) how to automatically generate math diagrams in problem-solving hints and evaluate their quality, (2) whether SVG is an effective intermediate representation for math diagrams, and (3) what prompting strategies and formats are required for LLMs to generate accurate SVG-based diagrams. Our contributions include defining the task of automatically generating SVG-based diagrams for math hints, developing an LLM prompting-based pipeline, and identifying key strategies for improving diagram generation. Additionally, we introduce a Visual Question Answering-based evaluation setup and conduct ablation studies to assess different pipeline variations. By automating the math diagram creation, we aim to provide students and teachers with accurate, conceptually relevant visual aids that enhance problem-solving and learning experiences.

📄 PDF Abstract BibTeX arXiv:2503.07429

Code (0)

등록된 구현이 없습니다.

Tasks

MathQuestion AnsweringVector GraphicsVisual Question Answering

Similar Papers 제목 키워드 기반

Generating Pedagogically Meaningful Visuals for Math Word Problems: A New Benchmark and Analysis of Text-to-Image Models

2025-06-04 · Junling Wang, Anna Rutkiewicz, April Yi Wang, Mrinmaya Sachan

Visuals are valuable tools for teaching math word problems (MWPs), helping young learners interpret textual descriptions into mathematical expressions before solving them. However, creating such visuals is labor-intensiv…

Math

Interactive Sketchpad: A Multimodal Tutoring System for Collaborative, Visual Problem-Solving

2025-02-12 · Steven-Shine Chen, JiMin Lee, Paul Pu Liang

Humans have long relied on visual aids like sketches and diagrams to support reasoning and problem-solving. Visual tools, like auxiliary lines in geometry or graphs in calculus, are essential for understanding complex id…

Mathmultimodal interaction

MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?

2024-03-21 · Renrui Zhang, Dongzhi Jiang, Yichi Zhang, Haokun Lin 외

The remarkable progress of Multi-modal Large Language Models (MLLMs) has garnered unparalleled attention, due to their superior performance in visual contexts. However, their capabilities in visual math problem-solving r…

MathMathematical Reasoning

RECODE: Reasoning Through Code Generation for Visual Question Answering

2025-10-15 · Junhong Shen, Mu Cai, Bo Hu, Ameet Talwalkar 외 arxiv

Multimodal Large Language Models (MLLMs) struggle with precise reasoning for structured visuals like charts and diagrams, as pixel-based perception lacks a mechanism for verification. To address this, we propose to lever…

Visual Question AnsweringMultimodal ReasoningVisual ReasoningCode Generation

Draw with Thought: Unleashing Multimodal Reasoning for Scientific Diagram Generation

2025-04-13 · Zhiqing Cui, Jiahao Yuan, Hanqing Wang, Yanshu Li 외

Scientific diagrams are vital tools for communicating structured knowledge across disciplines. However, they are often published as static raster images, losing symbolic semantics and limiting reuse. While Multimodal Lar…

Code GenerationMultimodal Reasoningvalid