paper-with-me

홈 › Papers

LAD-VF: LLM-Automatic Differentiation Enables Fine-Tuning-Free Robot Planning from Formal Methods Feedback

2025-09-22 · Yunhao Yang, Junyuan Hong, Gabriel Jacob Perin, Zhiwen Fan, Li Yin, Zhangyang Wang, Ufuk Topcu arxiv

Large language models (LLMs) can translate natural language instructions into executable action plans for robotics, autonomous driving, and other domains. Yet, deploying LLM-driven planning in the physical world demands strict adherence to safety and regulatory constraints, which current models often violate due to hallucination or weak alignment. Traditional data-driven alignment methods, such as Direct Preference Optimization (DPO), require costly human labeling, while recent formal-feedback approaches still depend on resource-intensive fine-tuning. In this paper, we propose LAD-VF, a fine-tuning-free framework that leverages formal verification feedback for automated prompt engineering. By introducing a formal-verification-informed text loss integrated with LLM-AutoDiff, LAD-VF iteratively refines prompts rather than model parameters. This yields three key benefits: (i) scalable adaptation without fine-tuning; (ii) compatibility with modular LLM architectures; and (iii) interpretable refinement via auditable prompts. Experiments in robot navigation and manipulation tasks demonstrate that LAD-VF substantially enhances specification compliance, improving success rates from 60% to over 90%. Our method thus presents a scalable and interpretable pathway toward trustworthy, formally-verified LLM-driven control systems.

📄 PDF Abstract BibTeX arXiv:2509.18384

Code (0)

등록된 구현이 없습니다.

Tasks

Prompt EngineeringAutonomous DrivingRobot Navigation

Similar Papers 제목 키워드 기반

On the Promise of the Stochastic Generalized Gauss-Newton Method for Training DNNs

2020-06-03 · Matilde Gargiani, Andrea Zanelli, Moritz Diehl, Frank Hutter

Following early work on Hessian-free methods for deep learning, we study a stochastic generalized Gauss-Newton method (SGN) for training DNNs. SGN is a second-order optimization method, with efficient iterations, that we…

Second-order methods

Differentiable Implicit Soft-Body Physics

2021-02-11 · Junior Rojas, Eftychios Sifakis, Ladislav Kavan

We present a differentiable soft-body physics simulator that can be composed with neural networks as a differentiable layer. In contrast to other differentiable physics approaches that use explicit forward models to defi…

Numerical Integration

Improved Marginal Unbiased Score Expansion (MUSE) via Implicit Differentiation

2022-09-21 · Marius Millea

We apply the technique of implicit differentiation to boost performance, reduce numerical error, and remove required user-tuning in the Marginal Unbiased Score Expansion (MUSE) algorithm for hierarchical Bayesian inferen…

Bayesian InferenceProbabilistic Programming

Universal Thermodynamic Interatomic Potentials for Crystalline Materials

2026-08-14 · Juno Nam, Bowen Deng, Xiaochen Du, Luis Barroso-Luque 외 arxiv

Free energies govern solid-state phase stability, yet computational materials discovery still relies largely on ground-state energies because free energy calculations require ensemble averages. We introduce the thermodyn…

One-step differentiation of iterative algorithms

2023-05-23 · NeurIPS 2023 11

In appropriate frameworks, automatic differentiation is transparent to the user at the cost of being a significant computational burden when the number of operations is large. For iterative algorithms, implicit different…

Bilevel Optimization