paper-with-me

홈 › Papers

Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correction

2025-08-05 · Yong Lin, Shange Tang, Bohan Lyu, Ziran Yang, Jui-Hui Chung, Haoyu Zhao, Lai Jiang, Yihan Geng, Jiawei Ge, Jingruo Sun, Jiayun Wu, Jiri Gesi, Ximing Lu, David Acuna, Kaiyu Yang, Hongzhou Lin, Yejin Choi, Danqi Chen, Sanjeev Arora, Chi Jin arxiv

We introduce Goedel-Prover-V2, a series of open-source language models that set a new state-of-the-art in automated theorem proving. Built on the standard expert iteration and reinforcement learning pipeline, our approach incorporates three key innovations: (1) Scaffolded data synthesis: We generate synthetic tasks of increasing difficulty to train the model to master increasingly complex theorems; (2) Verifier-guided self-correction: We enable the model to iteratively revise its proofs by leveraging feedback from the Lean compiler; (3) Model averaging: We merge model checkpoints to mitigate the decrease in model output diversity in later stages of training. Our small model, Goedel-Prover-V2-8B, reaches 84.6% pass@32 on MiniF2F and outperforms DeepSeek-Prover-V2-671B under the same metric, despite being 80X smaller. Our flagship model, Goedel-Prover-V2-32B, achieves 88.1% on MiniF2F at pass@32 in standard mode and 90.4% in self-correction mode, outperforming prior SOTA by a large margin. Additionally, our flagship model solves 86 problems on PutnamBench at pass@184, securing the first place among open-source models on the leaderboard, surpassing DeepSeek-Prover-V2-671B's record of solving 47 problems by pass@1024 with a significantly smaller model size and compute budget. At the time of its release (July-August 2025), Goedel-Prover-V2 achieves the strongest overall performance among all open-source theorem provers. It also ranks among the top-performing models--including closed-source systems with publicly reported performance--under a constrained test-time compute budget. Our models, code, and data are released at https://github.com/Goedel-LM/Goedel-Prover-V2.

📄 PDF Abstract BibTeX arXiv:2508.03613

Code (0)

등록된 구현이 없습니다.

Tasks

Automated Theorem ProvingReinforcement Learning

Similar Papers 제목 키워드 기반

Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Proving

2025-02-11 · Yong Lin, Shange Tang, Bohan Lyu, Jiayun Wu 외

We introduce Goedel-Prover, an open-source large language model (LLM) that achieves the state-of-the-art (SOTA) performance in automated formal proof generation for mathematical problems. The key challenge in this field …

Automated Theorem ProvingLarge Language ModelMath

Leanabell-Prover: Posttraining Scaling in Formal Reasoning

2025-04-08 · Jingyuan Zhang, Qi Wang, Xingguang Ji, Yahui Liu 외

Recent advances in automated theorem proving (ATP) through LLMs have highlighted the potential of formal reasoning with Lean 4 codes. However, ATP has not yet be revolutionized by the recent posttraining scaling as demon…

Automated Theorem Provingreinforcement-learningReinforcement Learning

Goedel-Architect: Streamlining Formal Theorem Proving with Blueprint Generation and Refinement

2026-06-04 · Jui-Hui Chung, Ziyang Cai, Zihao Li, Qishuo Yin 외 arxiv

We introduce Goedel-Architect, an agentic framework for formal theorem proving in Lean 4 centered on blueprint generation and refinement. A blueprint is a dependency graph of definitions and lemmas that builds up to the …

Inference-Time Diversity in RL-Trained Lean Theorem Provers: A Diagnostic Study

2026-01-22 · Zachary Burton arxiv

RL-trained Lean theorem provers mode-collapse at inference time: on miniF2F-test with DeepSeek-Prover-V1.5-RL, doubling the i.i.d.\ sampling budget from $k{=}32$ to $k{=}64$ produces zero additional solved theorems (42/2…

GAR: Generative Adversarial Reinforcement Learning for Formal Theorem Proving

2025-10-13 · Ruida Wang, Jiarui Yao, Rui Pan, Shizhe Diao 외 arxiv

Solving math problems through verifiable languages such as Lean has significantly impacted both the mathematics and computer science communities. Current state-of-the-art models are often trained with expensive online Re…

Reinforcement Learning