paper-with-me

홈 › Papers

Doctor-R1: Mastering Clinical Inquiry with Experiential Agentic Reinforcement Learning

2025-10-05 · Yunghwei Lai, Kaiming Liu, Ziyue Wang, Weizhi Ma, Yang Liu arxiv

The professionalism of a human doctor in outpatient service depends on two core abilities: the ability to make accurate medical decisions and the medical consultation skill to conduct strategic, empathetic patient inquiry. Existing Large Language Models (LLMs) have achieved remarkable accuracy on medical decision-making benchmarks. However, they often lack the ability to conduct the strategic and empathetic consultation, which is essential for real-world clinical scenarios. To address this gap, we propose Doctor-R1, an AI doctor agent trained to master both of the capabilities by ask high-yield questions and conduct strategic multi-turn inquiry to guide decision-making. Our framework introduces three key components: a multi-agent interactive environment, a two-tiered reward architecture that separately optimizes clinical decision-making and communicative inquiry skills, and an experience repository to ground policy learning in high-quality prior trajectories. We evaluate Doctor-R1 on OpenAI's HealthBench and MAQuE, assessed across multi-facet metrics, such as communication quality, user experience, and task accuracy. Remarkably, Doctor-R1 surpasses state-of-the-art open-source specialized LLMs by a substantial margin with higher parameter efficiency and outperforms powerful proprietary models. Furthermore, the human expert evaluations show that Doctor-R1 achieves superior clinical capability and patient-centric performance, demonstrating the effectiveness of the framework.

📄 PDF Abstract BibTeX arXiv:2510.04284

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

The Dialogue That Heals: A Comprehensive Evaluation of Doctor Agents' Inquiry Capability

2025-09-29 · Linlu Gong, Ante Wang, Yunghwei Lai, Weizhi Ma 외 arxiv

An effective physician should possess a combination of empathy, expertise, patience, and clear communication when treating a patient. Recent advances have successfully endowed AI doctors with expert diagnostic skills, pa…

DoctorRAG: Medical RAG Fusing Knowledge with Patient Analogy through Textual Gradients

2025-05-26 · Yuxing Lu, Gecheng Fu, Wei Wu, Xukai Zhao 외

Existing medical RAG systems mainly leverage knowledge from medical knowledge bases, neglecting the crucial role of experiential knowledge derived from similar patient cases -- a key component of human clinical reasoning…

Clinical KnowledgeRAGRetrieval

Proactive Knowledge Inquiry in Doctor-Patient Dialogue: Stateful Extraction, Belief Updating, and Path-Aware Action Planning

2026-03-18 · Zhenhai Pan, Yan Liu, Jia You arxiv

Most automated electronic medical record (EMR) pipelines remain output-oriented: they transcribe, extract, and summarize after the consultation, but they do not explicitly model what is already known, what is still missi…

Exploring the Inquiry-Diagnosis Relationship with Advanced Patient Simulators

2025-01-16 · Zhaocheng Liu, Quan Tu, Wen Ye, Yu Xiao 외

Online medical consultation (OMC) restricts doctors to gathering patient information solely through inquiries, making the already complex sequential decision-making process of diagnosis even more challenging. Recently, t…

DiagnosticSequential Decision Making

DxFormer: A Decoupled Automatic Diagnostic System Based on Decoder-Encoder Transformer with Dense Symptom Representations

2022-05-08 · Wei Chen, Cheng Zhong, Jiajie Peng, Zhongyu Wei

Diagnosis-oriented dialogue system queries the patient's health condition and makes predictions about possible diseases through continuous interaction with the patient. A few studies use reinforcement learning (RL) to le…

DecoderDiagnosticReinforcement Learning (RL)Text Generation