paper-with-me

홈 › Papers

On the Reliability Limits of LLM-Based Multi-Agent Planning

2026-03-27 · Ruicheng Ao, Siyang Gao, David Simchi-Levi arxiv

This technical note studies the reliability limits of LLM-based multi-agent planning as a delegated decision problem. We model the LLM-based multi-agent architecture as a finite acyclic decision network in which multiple stages process shared model-context information, communicate through language interfaces with limited capacity, and may invoke human review. We show that, without new exogenous signals, any delegated network is decision-theoretically dominated by a centralized Bayes decision maker with access to the same information. In the common-evidence regime, this implies that optimizing over multi-agent directed acyclic graphs under a finite communication budget can be recast as choosing a budget-constrained stochastic experiment on the shared signal. We also characterize the loss induced by communication and information compression. Under proper scoring rules, the gap between the centralized Bayes value and the value after communication admits an expected posterior divergence representation, which reduces to conditional mutual information under logarithmic loss and to expected squared posterior error under the Brier score. These results characterize the fundamental reliability limits of delegated LLM planning. Experiments with LLMs on a controlled problem set further demonstrate these characterizations.

📄 PDF Abstract BibTeX arXiv:2603.26993

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

DUPLEX: Agentic Dual-System Planning via LLM-Driven Information Extraction

2026-03-25 · Keru Hua, Ding Wang, Yaoying Gu, Xiaoguang Ma arxiv

While Large Language Models (LLMs) provide semantic flexibility for robotic task planning, their susceptibility to hallucination and logical inconsistency limits their reliability in long-horizon domains. To bridge the g…

Information ExtractionCode Generation

ProRefine: Inference-time Prompt Refinement with Textual Feedback

2025-06-05 · Deepak Pandita, Tharindu Cyril Weerasooriya, Ankit Parag Shah, Christopher M. Homan 외

Agentic workflows, where multiple AI agents collaborate to accomplish complex tasks like reasoning or planning, are becoming increasingly prevalent. However, these workflows often suffer from error propagation and sub-op…

Mathematical Reasoning

Evaluating Large Language Models as Live Strategic Agents: Provider Performance, Hybrid Decomposition, and Operational Gaps in Timed Risk Play

2026-05-21 · H. C. Ekne arxiv

Static benchmarks capture only part of how large language models behave in practice. Real systems place models inside repeated loops with time limits, formatting constraints, and failure modes. We study this setting in a…

SYMPHONY: Synergistic Multi-agent Planning with Heterogeneous Language Model Assembly

2026-01-30 · Wei Zhu, Zhiwen Tang, Kun Yue arxiv

Recent advancements have increasingly focused on leveraging large language models (LLMs) to construct autonomous agents for complex problem-solving tasks. However, existing approaches predominantly employ a single-agent …

VeriTrip: A Verifiable Benchmark for Travel Planning Agents over Unstructured Web Corpora

2026-05-27 · Yuting Xu, Jiayi Tian, Jian Liang, Xin Xiong 외 arxiv

Existing benchmarks have laid the foundation for travel planning agents by establishing API-centric paradigms. However, as the capabilities of Autonomous Agents continue to advance, their evaluation must evolve beyond si…