paper-with-me

Papers

DRIFT: Decompose, Retrieve, Illustrate, then Formalize Theorems

2025-10-12 · Meiru Zhang, Philipp Borchert, Milan Gritta, Gerasimos Lampouras arxiv

Automating the formalization of mathematical statements for theorem proving remains a major challenge for Large Language Models (LLMs). LLMs struggle to identify and utilize the prerequisite mathematical knowledge and its corresponding formal representation in languages like Lean. Current retrieval-augmented autoformalization methods query external libraries using the informal statement directly, but overlook a fundamental limitation: informal statements lack direct mappings to mathematical theorems and lemmata, nor do those theorems translate trivially into the formal primitives of languages like Lean. To address this, we introduce DRIFT, a novel framework that enables LLMs to decompose informal mathematical statements into smaller, more tractable "sub-components". This facilitates targeted retrieval of premises from mathematical libraries such as Mathlib. Additionally, DRIFT retrieves illustrative theorems to help models use premises more effectively in formalization tasks. We evaluate DRIFT across diverse benchmarks (ProofNet, ConNF, and MiniF2F-test) and find that it consistently improves premise retrieval, nearly doubling the F1 score compared to the DPR baseline on ProofNet. Notably, DRIFT demonstrates strong performance on the out-of-distribution ConNF benchmark, with BEq+@10 improvements of 42.25% and 37.14% using GPT-4.1 and DeepSeek-V3.1, respectively. Our analysis shows that retrieval effectiveness in mathematical autoformalization depends heavily on model-specific knowledge boundaries, highlighting the need for adaptive retrieval strategies aligned with each model's capabilities.

📄 PDF Abstract BibTeX arXiv:2510.10815

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

When Hard Negatives Hurt: Bridging the Generative-Discriminative Gap in Hard Negative Synthesis for Retrieval

2026-05-31 · Zhicheng Zhang, Jiwei Tang, Kuicai Dong, Xiaopeng Li 외 arxiv

Hard negative mining has become the dominant strategy for training retrievers, yet it faces intrinsic limitations: negatives are bounded by corpus availability, selected by retriever score rather than diagnostic value, a…

Contrastive Learning

Compositional Skill Routing for LLM Agents: Decompose, Retrieve, and Compose

2026-06-16 · Xueping Gao arxiv

LLM agents increasingly rely on external skills -- reusable tool specifications -- but real-world tasks often require composing multiple skills, not just selecting one. We formalize this as the Compositional Skill Routin…

Model Monitoring: A General Framework with an Application to Non-life Insurance Pricing

2025-10-06 · Alexej Brauer, Paul Menzel, Mario V. Wüthrich arxiv

Maintaining the predictive performance of pricing models is challenging when insurance portfolios and data-generating mechanisms evolve over time. Focusing on non-life insurance, we adopt the concept-drift terminology fr…

L^2R: Lifelong Learning for First-stage Retrieval with Backward-Compatible Representations

2023-08-22 · Yinqiong Cai, Keping Bi, Yixing Fan, Jiafeng Guo 외

First-stage retrieval is a critical task that aims to retrieve relevant document candidates from a large-scale collection. While existing retrieval models have achieved impressive performance, they are mostly studied on …

Lifelong learningRetrieval

Visconde: Multi-document QA with GPT-3 and Neural Reranking

2022-12-19 · Jayr Pereira, Robson Fidalgo, Roberto Lotufo, Rodrigo Nogueira

This paper proposes a question-answering system that can answer questions whose supporting evidence is spread over multiple (potentially long) documents. The system, called Visconde, uses a three-step pipeline to perform…

Language ModelingLanguage ModellingLarge Language ModelQuestion Answering+2