Do Clinical Models Change Treatment Decisions?
Clinical foundation models are evaluated with factual or exam-style medical QA, but treatment decisions must change when patient context changes. We introduce ClinPivot, an auditable treatment-decision benchmark built from biomedical relations and pivoted patient contexts. ClinPivot asks whether models change treatment choices when new clinical constraints shift the action space. We find that strong medical QA performance does not reliably predict decision-making performance: frontier models and task-adapted Qwen variants often fail to change decisions correctly, and model rankings shift across evaluation regimes. Decision-structured supervision improves pivot-sensitive decision-making and medical QA under matched knowledge budgets, while lightweight replay reduces losses in general assistant ability.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Medical World Model: Generative Simulation of Tumor Evolution for Treatment Planning
Providing effective treatment and making informed clinical decisions are essential goals of modern medicine and clinical care. We are interested in simulating disease dynamics for clinical decision-making, leveraging rec…
Decision MakingSpecificitySurvival AnalysisLearning Personalized Treatment Decisions in Precision Medicine: Disentangling Treatment Assignment Bias in Counterfactual Outcome Prediction and Biomarker Identification
Precision medicine has the potential to tailor treatment decisions to individual patients using machine learning (ML) and artificial intelligence (AI), but it faces significant challenges due to complex biases in clinica…
counterfactualMedDreamer: Model-Based Reinforcement Learning with Latent Imagination on Complex EHRs for Clinical Decision Support
Timely and personalized treatment decisions are essential across a wide range of healthcare settings where patient responses vary significantly and evolve over time. Clinical data used to support these decisions are ofte…
ImputationModel-based Reinforcement LearningRecommendation SystemsReinforcement Learning (RL)Assisting Clinical Decisions for Scarcely Available Treatment via Disentangled Latent Representation
Extracorporeal membrane oxygenation (ECMO) is an essential life-supporting modality for COVID-19 patients who are refractory to conventional therapies. However, the proper treatment decision has been the subject of signi…
counterfactualSelection biasA survey of open questions in adaptive therapy: bridging mathematics and clinical translation
Adaptive therapy is a dynamic cancer treatment protocol that updates (or "adapts") treatment decisions in anticipation of evolving tumor dynamics. This broad term encompasses many possible dynamic treatment protocols of …