paper-with-me

Papers

RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory

2025-08-06 · Jun Liu, Zhenglun Kong, Changdi Yang, Fan Yang, Tianqi Li, Peiyan Dong, Joannah Nanjekye, Hao Tang, Geng Yuan, Wei Niu, Wenbin Zhang, Pu Zhao, Xue Lin, Dong Huang, Yanzhi Wang arxiv

Multi-agent large language model (LLM) systems have shown strong potential in complex reasoning and collaborative decision-making tasks. However, most existing coordination schemes rely on static or full-context routing strategies, which lead to excessive token consumption, redundant memory exposure, and limited adaptability across interaction rounds. We introduce RCR-Router, a modular and role-aware context routing framework designed to enable efficient, adaptive collaboration in multi-agent LLMs. To our knowledge, this is the first routing approach that dynamically selects semantically relevant memory subsets for each agent based on its role and task stage, while adhering to a strict token budget. A lightweight scoring policy guides memory selection, and agent outputs are iteratively integrated into a shared memory store to facilitate progressive context refinement. To better evaluate model behavior, we further propose an Answer Quality Score metric that captures LLM-generated explanations beyond standard QA accuracy. Experiments on three multi-hop QA benchmarks -- HotPotQA, MuSiQue, and 2WikiMultihop -- demonstrate that RCR-Router reduces token usage (up to 30%) while improving or maintaining answer quality. These results highlight the importance of structured memory routing and output-aware evaluation in advancing scalable multi-agent LLM systems.

📄 PDF Abstract BibTeX arXiv:2508.04903

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

When Routing Collapses: On the Degenerate Convergence of LLM Routers

2026-02-03 · Guannan Lai, Han-Jia Ye arxiv

LLM routing aims to achieve a favorable quality--cost trade-off by dynamically assigning easy queries to smaller models and harder queries to stronger ones. However, across both unimodal and multimodal settings, we uncov…

The Workload-Router-Pool Architecture for LLM Inference Optimization: A Vision Paper from the vLLM Semantic Router Project

2026-03-22 · Huamin Chen, Xunzhuo Liu, Bowei He, Fuyuan Lyu 외 arxiv

Over the past year, the vLLM Semantic Router project has released a series of work spanning: (1) core routing mechanisms -- signal-driven routing, context-length pool routing, router performance engineering, policy confl…

CASTER: Breaking the Cost-Performance Barrier in Multi-Agent Orchestration via Context-Aware Strategy for Task Efficient Routing

2026-01-27 · Shanyv Liu, Xuyang Yuan, Tao Chen, Zijun Zhan 외 arxiv

Graph-based Multi-Agent Systems (MAS) enable complex cyclic workflows but suffer from inefficient static model allocation, where deploying strong models uniformly wastes computation on trivial sub-tasks. We propose CASTE…

NG-Router: Graph-Supervised Multi-Agent Collaboration for Nutrition Question Answering

2025-10-10 · Kaiwen Shi, Zheyuan Zhang, Zhengqing Yuan, Keerthiram Murugesan 외 arxiv

Diet plays a central role in human health, and Nutrition Question Answering (QA) offers a promising path toward personalized dietary guidance and the prevention of diet-related chronic diseases. However, existing methods…

Relational ReasoningGraph Neural NetworkQuestion AnsweringKnowledge Graphs

ACE-Router: Generalizing History-Aware Routing from MCP Tools to the Agent Web

2026-01-13 · Zhiyuan Yao, Zishan Xu, Yifu Guo, Zhiguang Han 외 arxiv

With the rise of the Agent Web and Model Context Protocol (MCP), the agent ecosystem is evolving into an open collaborative network, exponentially increasing accessible tools. However, current architectures face severe s…