paper-with-me

홈 › Papers

DDX-TRACE: A Benchmark for Medical Diagnostic Trajectories in VLMs

2026-05-22 · Jiazhen Pan, Weixiang Shen, Jun Li, Julian Canisius, Felix Bitzer, Paula Roßmüller, Jiancheng Yang, Virginie Kreutzinger, Daniel Rueckert, Benedikt Wiestler arxiv

Medical diagnosis is not a single prediction from a fully specified vignette. It is a sequential workup: clinicians decide what evidence to obtain, revise a differential diagnosis, and stop when the diagnosis is sufficiently supported. Most medical AI benchmarks instead reveal the relevant context upfront and score only the final answer, making unsupported correct guesses, premature closure, inefficient workups, and poor uncertainty updating invisible. We introduce DDX-TRACE, a physician-adjudicated benchmark for multimodal neuroradiology that evaluates diagnostic trajectories under hidden evidence over 211 challenging cases. Each case begins with limited clinical history; models request imaging studies in free form, receive matched image bundles when available, update a probabilistic differential diagnosis after each turn, and stop with a localized final diagnosis. Evaluating state-of-the-art VLMs, we find that final diagnosis scores can substantially misrepresent workup quality: models may guess plausible diagnoses without essential evidence, request useful studies but misinterpret raw images, or acquire evidence inefficiently while updating uncertainty poorly. Controlled evidence variants isolate bottlenecks in planning, visual evidence extraction, and downstream differential reasoning. DDX-TRACE shifts medical AI evaluation from final answers to evidence-supported diagnostic trajectories.

📄 PDF Abstract BibTeX arXiv:2605.23629

Code (0)

등록된 구현이 없습니다.

Tasks

Medical Diagnosis

Similar Papers 제목 키워드 기반

A Medical Multimodal Diagnostic Framework Integrating Vision-Language Models and Logic Tree Reasoning

2025-12-25 · Zelin Zang, Wenyi Gu, Siqi Ma, Dan Yang 외 arxiv

With the rapid growth of large language models (LLMs) and vision-language models (VLMs) in medicine, simply integrating clinical text and medical imaging does not guarantee reliable reasoning. Existing multimodal models …

OpenMedReason: Scientific Reasoning Supervision for Medical Vision-Language Models

2026-06-10 · Negin Baghbanzadeh, Pritam Sarkar, Michael Colacci, Abeer Badawi 외 arxiv

High-stakes clinical use of large vision-language models (LVLMs) requires reasoning that is grounded in visual evidence and clinical knowledge, not just correct final answers. We introduce OpenMedReason, a large-scale, o…

Clinical Knowledge

DrVD-Bench: Do Vision-Language Models Reason Like Human Doctors in Medical Image Diagnosis?

2025-05-30 · Tianhong Zhou, Yin Xu, Yingtao Zhu, Chuxi Xiao 외

Vision-language models (VLMs) exhibit strong zero-shot generalization on natural images and show early promise in interpretable medical image analysis. However, existing benchmarks do not systematically evaluate whether …

DiagnosticMedical Image AnalysisVisual ReasoningZero-shot Generalization

StateTrace: An Object-Centric Framework for Hidden-State Spatiotemporal Reasoning in Long Videos

2026-08-19 · Yu Han, Wenhao Li, Yichao Cao, Hongyan Xu 외 arxiv

Existing VLMs have achieved strong performance in video understanding, yet they struggle with long-video spatiotemporal reasoning when target objects become invisible, often mistaking "invisible" for "unknown". We define…

Step-CoT: Stepwise Visual Chain-of-Thought for Medical Visual Question Answering

2026-03-14 · Lin Fan, Yafei Ou, Zhipeng Deng, Pengyu Dai 외 arxiv

Chain-of-thought (CoT) reasoning has advanced medical visual question answering (VQA), yet most existing CoT rationales are free-form and fail to capture the structured reasoning process clinicians actually follow. This …

Visual Question Answering