paper-with-me

홈 › Papers

Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Proving

2025-02-11 · Yong Lin, Shange Tang, Bohan Lyu, Jiayun Wu, Hongzhou Lin, Kaiyu Yang, Jia Li, Mengzhou Xia, Danqi Chen, Sanjeev Arora, Chi Jin

We introduce Goedel-Prover, an open-source large language model (LLM) that achieves the state-of-the-art (SOTA) performance in automated formal proof generation for mathematical problems. The key challenge in this field is the scarcity of formalized math statements and proofs, which we tackle in the following ways. We train statement formalizers to translate the natural language math problems from Numina into formal language (Lean 4), creating a dataset of 1.64 million formal statements. LLMs are used to check that the formal statements accurately preserve the content of the original natural language problems. We then iteratively build a large dataset of formal proofs by training a series of provers. Each prover succeeds in proving many statements that the previous ones could not, and these new proofs are added to the training set for the next prover. The final prover outperforms all existing open-source models in whole-proof generation. On the miniF2F benchmark, it achieves a 57.6% success rate (Pass@32), exceeding the previous best open-source model by 7.6%. On PutnamBench, Goedel-Prover successfully solves 7 problems (Pass@512), ranking first on the leaderboard. Furthermore, it generates 29.7K formal proofs for Lean Workbook problems, nearly doubling the 15.7K produced by earlier works.

📄 PDF Abstract BibTeX arXiv:2502.07640

Code (1)

Goedel-LM/Goedel-Prover 공식 구현 pytorch

Tasks

Automated Theorem ProvingLarge Language ModelMath

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correction

2025-08-05 · Yong Lin, Shange Tang, Bohan Lyu, Ziran Yang 외 arxiv

We introduce Goedel-Prover-V2, a series of open-source language models that set a new state-of-the-art in automated theorem proving. Built on the standard expert iteration and reinforcement learning pipeline, our approac…

Automated Theorem ProvingReinforcement Learning

Goedel-Code-Prover: Hierarchical Proof Search for Open State-of-the-Art Code Verification

2026-03-18 · Zenan Li, Ziran Yang, Deyuan He, Haoyu Zhao 외 arxiv

Large language models (LLMs) can generate plausible code but offer limited guarantees of correctness. Formally verifying that implementations satisfy specifications requires constructing machine-checkable proofs, a task …

Reinforcement Learning

Goedel-Architect: Streamlining Formal Theorem Proving with Blueprint Generation and Refinement

2026-06-04 · Jui-Hui Chung, Ziyang Cai, Zihao Li, Qishuo Yin 외 arxiv

We introduce Goedel-Architect, an agentic framework for formal theorem proving in Lean 4 centered on blueprint generation and refinement. A blueprint is a dependency graph of definitions and lemmas that builds up to the …

Leanabell-Prover: Posttraining Scaling in Formal Reasoning

2025-04-08 · Jingyuan Zhang, Qi Wang, Xingguang Ji, Yahui Liu 외

Recent advances in automated theorem proving (ATP) through LLMs have highlighted the potential of formal reasoning with Lean 4 codes. However, ATP has not yet be revolutionized by the recent posttraining scaling as demon…

Automated Theorem Provingreinforcement-learningReinforcement Learning

Inference-Time Diversity in RL-Trained Lean Theorem Provers: A Diagnostic Study

2026-01-22 · Zachary Burton arxiv

RL-trained Lean theorem provers mode-collapse at inference time: on miniF2F-test with DeepSeek-Prover-V1.5-RL, doubling the i.i.d.\ sampling budget from $k{=}32$ to $k{=}64$ produces zero additional solved theorems (42/2…