paper-with-me

Papers

Forethought: Verifiable Reasoning from Neurosymbolic Primitive Programming

2026-07-05 · Vishvesh Bhat, Jay Vaghasiya, Emmanuel Anaya Gonzalez arxiv

Current agentic workflows usually involve decomposing user requests into sequences of tool calls with correctly resolved parameters, the results of which are processed through reasoning traces in the language model's context window. The prevailing route to improve such reasoning is test-time scaling, which trains models to search over long chains of thought; but the resulting capability is entangled in model weights, is not verifiable step-by-step, and is costly at inference. We present Forethought, a neurosymbolic reasoning system that instead treats reasoning as an explicit, verifiable program, that builds from a library of symbolic and neural primitives which are composed through a domain-specific language. The result are reasoning programs, which are concrete representations of the model's work, and as such can be inspected and modified before deployment. Instantiated as a tool-calling execution kernel and evaluated across five benchmarks, Forethought improves base-model accuracy by about 30% relative and outperforms vanilla prompting, reinforcement learning scaffolds, and prompt-evolution methods, enabling small models to match or exceed frontier models capabilities. In a direct comparison, a non-reasoning model augmented with Forethought competes with a dedicated reasoning model while requiring roughly three orders of magnitude less post-training investment, and remains model-agnostic and auditable.

📄 PDF Abstract BibTeX arXiv:2607.04096

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

Cross-Domain Demo-to-Code via Neurosymbolic Counterfactual Reasoning

2026-03-19 · Jooyoung Kim, Wonje Choi, Younguk Song, Honguk Woo arxiv

Recent advances in Vision-Language Models (VLMs) have enabled video-instructed robotic programming, allowing agents to interpret video demonstrations and generate executable control code. We formulate video-instructed ro…

Domain Adaptation

Towards a Neurosymbolic Reasoning System Grounded in Schematic Representations

2025-09-03 · François Olivier, Zied Bouraoui arxiv

Despite significant progress in natural language understanding, Large Language Models (LLMs) remain error-prone when performing logical reasoning, often lacking the robust mental representations that enable human-like co…

Natural Language UnderstandingSpatial ReasoningLogical Reasoning

Lobster: A GPU-Accelerated Framework for Neurosymbolic Programming

2025-03-27 · Paul Biberstein, Ziyang Li, Joseph Devietti, Mayur Naik

Neurosymbolic programs combine deep learning with symbolic reasoning to achieve better data efficiency, interpretability, and generalizability compared to standalone deep learning approaches. However, existing neurosymbo…

GPU

Current Practices for Building LLM-Powered Reasoning Tools Are Ad Hoc -- and We Can Do Better

2025-07-08 · Aaron Bembenek arxiv

There is growing excitement about building software verifiers, synthesizers, and other Automated Reasoning (AR) tools by combining traditional symbolic algorithms and Large Language Models (LLMs). Unfortunately, the curr…

Logical Reasoning

SymCode: A Neurosymbolic Approach to Mathematical Reasoning via Verifiable Code Generation

2025-10-29 · Sina Bagheri Nezhad, Yao Li, Ameeta Agrawal arxiv

Large Language Models (LLMs) often struggle with complex mathematical reasoning, where prose-based generation leads to unverified and arithmetically unsound solutions. Current prompting strategies like Chain of Thought s…

Mathematical ReasoningLogical FallaciesCode Generation