paper-with-me

홈 › Papers

Scientific Graphics Program Synthesis via Dual Self-Consistency Reinforcement Learning

2026-04-07 · Juekai Lin, Yun Zhu, Honglin Lin, Sijing Li, Tianwei Lin, Zheng Liu, Xiaoyang Wang, Wenqiao Zhang, Lijun Wu arxiv

Graphics Program Synthesis is pivotal for interpreting and editing visual data, effectively facilitating the reverse-engineering of static visuals into editable TikZ code. While TikZ is the de facto standard for scientific schematics due to its programmatic flexibility, its requirement for rigorous spatial precision presents a significant challenge for Multimodal Large Language Models. Progress is currently stifled by two primary gaps: (1) Data Quality Gap: existing image-TikZ corpora often lack strict executability and reliable visual alignment; (2) Evaluation Gap: a lack of benchmarks for both structural and visual fidelity. To address these, we present a closed-loop framework featuring: SciTikZ-230K, a large-scale, high-quality dataset from our Execution-Centric Data Engine covering 11 diverse scientific disciplines; SciTikZ-Bench, a multifaceted benchmark spanning from basic geometric constructs to intricate hierarchical schematics to evaluate both visual fidelity and structural logic. To further broaden the scope of visual-code optimization methodology, we introduce a novel Dual Self-Consistency Reinforcement Learning optimization paradigm, which utilizes Round-Trip Verification to penalize degenerate code and boost overall self-consistency. Empowered by these, our trained model SciTikZer-8B achieves state-of-the-art performance, consistently outperforming proprietary giants like Gemini-2.5-Pro and massive models like Qwen3-VL-235B-A22B-Instruct.

📄 PDF Abstract BibTeX arXiv:2604.06079

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningProgram Synthesis

Similar Papers 제목 키워드 기반

Can Large Language Models Understand Symbolic Graphics Programs?

2024-08-15 · Zeju Qiu, Weiyang Liu, Haiwen Feng, Zhen Liu 외

Against the backdrop of enthusiasm for large language models (LLMs), there is an urgent need to scientifically assess their capabilities and shortcomings. This is nontrivial in part because it is difficult to find tasks …

Instruction FollowingProgram Synthesis

TikZero: Zero-Shot Text-Guided Graphics Program Synthesis

2025-03-14 · Jonas Belouadi, Eddy Ilg, Margret Keuper, Hideki Tanaka 외

With the rise of generative AI, synthesizing figures from text captions becomes a compelling application. However, achieving high geometric precision and editability requires representing figures as graphics programs in …

Program Synthesis

Learning to Infer Graphics Programs from Hand-Drawn Images

2017-07-30 · ICLR 2018 1 · Kevin Ellis, Daniel Ritchie, Armando Solar-Lezama, Joshua B. Tenenbaum

We introduce a model that learns to convert simple hand drawings into graphics programs written in a subset of \LaTeX. The model combines techniques from deep learning and program synthesis. We learn a convolutional neur…

Program Synthesis

Report of the Workshop on Program Synthesis for Scientific Computing

2021-02-02 · Hal Finkel, Ignacio Laguna

Program synthesis is an active research field in academia, national labs, and industry. Yet, work directly applicable to scientific computing, while having some impressive successes, has been limited. This report reviews…

Program Synthesis

DeTikZify: Synthesizing Graphics Programs for Scientific Figures and Sketches with TikZ

2024-05-24 · Jonas Belouadi, Simone Paolo Ponzetto, Steffen Eger

Creating high-quality scientific figures can be time-consuming and challenging, even though sketching ideas on paper is relatively easy. Furthermore, recreating existing figures that are not stored in formats preserving …

Language ModelingLanguage Modelling