Trust but Verify:Evidence-Linked Multi-Agent Clinical Information Extraction in Pathology
Clinical feature extraction from pathology reports is challenging because relevant evidence may be distributed across coded and narrative fields and depend on specimen attribution, negation, ancillary findings, and diagnostic context. We retrospectively evaluated the NimbleMind Multi-Agent System (nMAS), a configurable workflow that separates clinician-defined field specifications from extraction models and returns report-level predictions with source-linked evidence. The study included 54 dummy gastric biopsy pathology reports from Singapore and four binary target fields, yielding 216 feature-case decisions. nMAS correctly classified 213 of 216 decisions (98.61\%), and all evidence spans associated with correct predictions occurred verbatim in the corresponding source reports. All three errors occurred in the two context-dependent \textit{H. pylori}-related fields requiring negation handling or diagnostic attribution. A single-model UMA-style comparator produced the similar label-level performance and error pattern. These findings do not demonstrate predictive superiority for the multi-agent architecture.Rather, the contribution of nMAS lies in workflow integration and traceability through configurable field specifications, complexity-based routing, report-level aggregation, and source-text validation within a clinician-reviewable workflow. Larger multi-institutional studies should assess generalizability, semantic evidence quality, adaptation effort, and clinician verification time.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
From Agent Traces to Trust: A Survey of Evidence Tracing and Execution Provenance in LLM Agents
Large language model (LLM)-based agents are evolving from passive text generators into autonomous systems capable of planning, tool use, retrieval, memory access, environmental interaction, and multi-agent collaboration.…
TessPay: Verify-then-Pay Infrastructure for Trusted Agentic Commerce
The global economy is entering the era of Agentic Commerce, where autonomous agents can discover services, negotiate prices, and transact value. However adoption towards agentic commerce faces a foundational trust gap: c…
On the Importance of Trust in Next-Generation Networked CPS Systems: An AI Perspective
With the increasing scale, complexity, and heterogeneity of the next generation networked systems, seamless control, management, and security of such systems becomes increasingly challenging. Many diverse applications ha…
Decision MakingFederated LearningManagementTrust, but Verify! Better Entity Linking through Automatic Verification
We introduce automatic verification as a post-processing step for entity linking (EL). The proposed method trusts EL system results collectively, by assuming entity mentions are mostly linked correctly, in order to creat…
Entity LinkingOpenAgenet / OAN White Paper: Open Infrastructure for Trusted Agent Interconnection
OpenAgenet, abbreviated as OAN, is an open infrastructure project for trusted Agent interconnection. It addresses a problem that becomes visible when Agents move from isolated applications into open, multi-operator netwo…