PropUQ-MAS: Propagation-Aware Uncertainty Quantification for LLM Multi-Agent Systems
LLM-based multi-agent systems (MAS) solve complex tasks through communication among role-specialized agents. However, inter-agent dependencies introduce reliability risks beyond isolated agent failures. For instance, errors in intermediate messages could be inherited and amplified by downstream agents. Existing uncertainty quantification (UQ) methods mainly target isolated responses or single-agent reasoning, and therefore fail to capture uncertainty propagation in MAS. To this end, we propose PropUQ-MAS, an error propagation-aware UQ framework that represents MAS execution as a communication-structured graph and estimates each step's reliability by combining local uncertainty with uncertainty inherited from upstream messages. Extensive experiments demonstrate that PropUQ-MAS consistently improves UQ in MAS, with average relative gains of +6.10% in AUROC and +47.58% in PRR.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Structure-Aware Epistemic Uncertainty Quantification for Neural Operator PDE Surrogates
Neural operators (NOs) provide fast, resolution-invariant surrogates for mapping input fields to PDE solution fields, but their predictions can exhibit significant epistemic uncertainty due to finite data, imperfect opti…
Collaborative Multi-Object Tracking with Conformal Uncertainty Propagation
Object detection and multiple object tracking (MOT) are essential components of self-driving systems. Accurate detection and uncertainty quantification are both critical for onboard modules, such as perception, predictio…
Autonomous VehiclesConformal Predictionmotion predictionMulti-Object Tracking+6Uncertainty Propagation Networks for Neural Ordinary Differential Equations
This paper introduces Uncertainty Propagation Network (UPN), a novel family of neural differential equations that naturally incorporate uncertainty quantification into continuous-time modeling. Unlike existing neural ODE…
Trajectory PredictionUncertainty-Aware Metabolic Stability Prediction with Dual-View Contrastive Learning
Accurate prediction of molecular metabolic stability (MS) is critical for drug research and development but remains challenging due to the complex interplay of molecular interactions. Despite recent advances in graph neu…
Contrastive LearningPredictionUncertainty QuantificationUA-ChatDev: Uncertainty-Aware Multi-Agent Collaboration for Reliable Software Development
Software development is a complex task that demands cooperation among agents with diverse roles. Large language models (LLMs) have enabled autonomous multi-agent software development frameworks that leverage role-based c…