paper-with-me

Papers

Consistent Autoformalization for Constructing Mathematical Libraries

2024-10-05 · Lan Zhang, Xin Quan, Andre Freitas

Autoformalization is the task of automatically translating mathematical content written in natural language to a formal language expression. The growing language interpretation capabilities of Large Language Models (LLMs), including in formal languages, are lowering the barriers for autoformalization. However, LLMs alone are not capable of consistently and reliably delivering autoformalization, in particular as the complexity and specialization of the target domain grows. As the field evolves into the direction of systematically applying autoformalization towards large mathematical libraries, the need to improve syntactic, terminological and semantic control increases. This paper proposes the coordinated use of three mechanisms, most-similar retrieval augmented generation (MS-RAG), denoising steps, and auto-correction with syntax error feedback (Auto-SEF) to improve autoformalization quality. The empirical analysis, across different models, demonstrates that these mechanisms can deliver autoformalizaton results which are syntactically, terminologically and semantically more consistent. These mechanisms can be applied across different LLMs and have shown to deliver improve results across different model types.

📄 PDF Abstract BibTeX arXiv:2410.04194

Code (1)

lanzhang128/retrieval_augmented_autoformalization 공식 구현

Tasks

DenoisingRAGRetrieval-augmented Generation

Similar Papers 제목 키워드 기반

DRIFT: Decompose, Retrieve, Illustrate, then Formalize Theorems

2025-10-12 · Meiru Zhang, Philipp Borchert, Milan Gritta, Gerasimos Lampouras arxiv

Automating the formalization of mathematical statements for theorem proving remains a major challenge for Large Language Models (LLMs). LLMs struggle to identify and utilize the prerequisite mathematical knowledge and it…

MathForm: Scaling Mathematical Autoformalization with Knowledge Retrieval and Verification-Guided Refinement

2026-08-14 · Lushi Pu, Weiming Zhang, Xinheng Xie, Zixuan Fu 외 arxiv

Autoformalization is commonly framed as translating natural-language mathematical statements into machine-verifiable formal languages such as Lean 4. However, faithful formalization requires more than translation. Models…

Reinforcement Learning

Formalizing Complex Mathematical Statements with LLMs: A Study on Mathematical Definitions

2025-02-17 · Lan Zhang, Marco Valentino, Andre Freitas

Thanks to their linguistic capabilities, LLMs offer an opportunity to bridge the gap between informal mathematics and formal languages through autoformalization. However, it is still unclear how well LLMs generalize to s…

Multi-agent Autoformalization of Tensor Network Theory

2026-07-08 · Sirui Lu, Erickson Tjoa, J. Ignacio Cirac arxiv

We build a team of specialized large language-model agents and present an agent-driven workflow for research-level formalization in theoretical physics, with the autoformalization of the fundamental theorem of matrix-pro…

Autoformalization in the Era of Large Language Models: A Survey

2025-05-29 · Ke Weng, Lun Du, Sirui Li, Wangyue Lu 외

Autoformalization, the process of transforming informal mathematical propositions into verifiable formal representations, is a foundational task in automated theorem proving, offering a new perspective on the use of math…

Automated Theorem Proving