paper-with-me

Papers

MASPO: Joint Prompt Optimization for LLM-based Multi-Agent Systems

2026-05-07 · Zhexuan Wang, Xuebo Liu, Li Wang, Zifei Shan, Yutong Wang, Zhenxi Song, Min Zhang arxiv

Large language model (LLM)-based Multi-agent systems (MAS) have shown promise in tackling complex collaborative tasks, where agents are typically orchestrated via role-specific prompts. While the quality of these prompts is pivotal, jointly optimizing them across interacting agents remains a non-trivial challenge, primarily due to the misalignment between local agent objectives and holistic system goals. To address this, we introduce MASPO, a novel framework designed to automatically and iteratively refine prompts across the entire system. A core innovation of MASPO is its joint evaluation mechanism, which assesses prompts not merely by their local validity, but by their capacity to facilitate downstream success for successor agents. This effectively bridges the gap between local interactions and global outcomes without relying on ground-truth labels. Furthermore, MASPO employs a data-driven evolutionary beam search to efficiently navigate the high-dimensional prompt space. Extensive empirical evaluations across 6 diverse tasks demonstrate that MASPO consistently outperforms state-of-the-art prompt optimization methods, achieving an average accuracy improvement of 2.9. We release our code at https://github.com/wangzx1219/MASPO.

📄 PDF Abstract BibTeX arXiv:2605.06623

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

MASPOB: Bandit-Based Prompt Optimization for Multi-Agent Systems with Graph Neural Networks

2026-03-03 · Zhi Hong, Qian Zhang, Jiahang Sun, Zhiwei Shang 외 arxiv

Large Language Models (LLMs) have achieved great success in many real-world applications, especially the one serving as the cognitive backbone of Multi-Agent Systems (MAS) to orchestrate complex workflows in practice. Si…

Rethinking Ratio-Based Trust Regions for Policy Optimization in Multi-Agent Reinforcement Learning

2026-05-09 · Chulabhaya Wijesundara, Andrea Baisero, Zhongheng Li, Gregory Castañón 외 arxiv

Centralized training with decentralized execution (CTDE) is a standard framework for cooperative multi-agent policy-gradient reinforcement learning, allowing agents to learn from joint information while acting from local…

Multi-agent Reinforcement Learning

MASPO: Unifying Gradient Utilization, Probability Mass, and Signal Reliability for Robust and Sample-Efficient LLM Reasoning

2026-02-19 · Xiaoliang Fu, Jiaye Lin, Yangyi Fang, Binbin Zheng 외 arxiv

Existing Reinforcement Learning with Verifiable Rewards (RLVR) algorithms, such as GRPO, rely on rigid, uniform, and symmetric trust region mechanisms that are fundamentally misaligned with the complex optimization dynam…

Reinforcement Learning

JTPRO: A Joint Tool-Prompt Reflective Optimization Framework for Language Agents

2026-04-20 · Sandip Ghoshal, Anshul Mittal, Jyotika Singh, Miguel Ballesteros 외 arxiv

Large language model (LLM) agents augmented with external tools often struggle as number of tools grow large and become domain-specific. In such settings, ambiguous tool descriptions and under-specified agent instruction…

Slot Filling

Maestro: Joint Graph & Config Optimization for Reliable AI Agents

2025-09-04 · Wenxiao Wang, Priyatham Kattakinda, Soheil Feizi arxiv

Building reliable LLM agents requires decisions at two levels: the graph (which modules exist and how information flows) and the configuration of each node (models, prompts, tools, control knobs). Most existing optimizer…