paper-with-me

홈 › Papers

MMedAgent-RL: Optimizing Multi-Agent Collaboration for Multimodal Medical Reasoning

2025-05-31 · Peng Xia, Jinglu Wang, Yibo Peng, Kaide Zeng, Xian Wu, Xiangru Tang, Hongtu Zhu, Yun Li, Shujie Liu, Yan Lu, Huaxiu Yao

Medical Large Vision-Language Models (Med-LVLMs) have shown strong potential in multimodal diagnostic tasks. However, existing single-agent models struggle to generalize across diverse medical specialties, limiting their performance. Recent efforts introduce multi-agent collaboration frameworks inspired by clinical workflows, where general practitioners (GPs) and specialists interact in a fixed sequence. Despite improvements, these static pipelines lack flexibility and adaptability in reasoning. To address this, we propose MMedAgent-RL, a reinforcement learning (RL)-based multi-agent framework that enables dynamic, optimized collaboration among medical agents. Specifically, we train two GP agents based on Qwen2.5-VL via RL: the triage doctor learns to assign patients to appropriate specialties, while the attending physician integrates the judgments from multi-specialists and its own knowledge to make final decisions. To address the inconsistency in specialist outputs, we introduce a curriculum learning (CL)-guided RL strategy that progressively teaches the attending physician to balance between imitating specialists and correcting their mistakes. Experiments on five medical VQA benchmarks demonstrate that MMedAgent-RL not only outperforms both open-source and proprietary Med-LVLMs, but also exhibits human-like reasoning patterns. Notably, it achieves an average performance gain of 18.4% over supervised fine-tuning baselines.

📄 PDF Abstract BibTeX arXiv:2506.00555

Code (0)

등록된 구현이 없습니다.

Tasks

DiagnosticReinforcement Learning (RL)Visual Question Answering (VQA)

Similar Papers 제목 키워드 기반

MMedAgent: Learning to Use Medical Tools with Multi-modal Agent

2024-07-02 · Binxu Li, Tiankai Yan, Yuanting Pan, Jie Luo 외

Multi-Modal Large Language Models (MLLMs), despite being successful, exhibit limited generality and often fall short when compared to specialized models. Recently, LLM-based agents have been developed to address these ch…

TeamMedAgents: Pareto-Efficient Multi-Agent Medical Reasoning Through Teamwork Theory

2025-08-11 · Pranav Pushkar Mishra, Mohammad Arvan, Mohan Zalake arxiv

Complex medical reasoning has historically required frontier language models to achieve clinically-acceptable accuracy, creating computational barriers that limit deployment in resource-constrained clinical settings. We …

Mediator-Guided Multi-Agent Collaboration among Open-Source Models for Medical Decision-Making

2025-08-08 · Kaitao Chen, Mianxin Liu, Daoming Zong, Chaoyue Ding 외 arxiv

Complex medical decision-making involves cooperative workflows operated by different clinicians. Designing AI multi-agent systems can expedite and augment human-level clinical decision-making. Existing multi-agent resear…

Instruction FollowingQuestion Answering

MECoBench: A Systematic Study of Multimodal Agent Collaboration in Embodied Environments

2026-06-30 · Qingyun Liu, Jiwen Zhang, Jingyi Hu, Siyuan Wang 외 arxiv

Recent multimodal large language models (MLLMs) have strong potential as embodied agents, but their ability to collaborate in visually grounded environments remains underexplored. To address this gap, we introduce MECoBe…

FutureWeaver: Planning Test-Time Compute for Multi-Agent Systems with Modularized Collaboration

2025-12-12 · Dongwon Jung, Peng Shi, Muhao Chen, Yi Zhang arxiv

Scaling test-time computation has been shown to significantly improve large language model (LLM) performance without additional training. However, extending these techniques to multi-agent systems remains challenging: ex…