paper-with-me

홈 › Papers

Large Language Models are Clinical Reasoners: Reasoning-Aware Diagnosis Framework with Prompt-Generated Rationales

2023-12-12 · Taeyoon Kwon, Kai Tzu-iunn Ong, Dongjin Kang, Seungjun Moon, Jeong Ryong Lee, Dosik Hwang, Yongsik Sim, Beomseok Sohn, Dongha Lee, Jinyoung Yeo

Machine reasoning has made great progress in recent years owing to large language models (LLMs). In the clinical domain, however, most NLP-driven projects mainly focus on clinical classification or reading comprehension, and under-explore clinical reasoning for disease diagnosis due to the expensive rationale annotation with clinicians. In this work, we present a "reasoning-aware" diagnosis framework that rationalizes the diagnostic process via prompt-based learning in a time- and labor-efficient manner, and learns to reason over the prompt-generated rationales. Specifically, we address the clinical reasoning for disease diagnosis, where the LLM generates diagnostic rationales providing its insight on presented patient data and the reasoning path towards the diagnosis, namely Clinical Chain-of-Thought (Clinical CoT). We empirically demonstrate LLMs/LMs' ability of clinical reasoning via extensive experiments and analyses on both rationale generation and disease diagnosis in various settings. We further propose a novel set of criteria for evaluating machine-generated rationales' potential for real-world clinical settings, facilitating and benefiting future research in this area.

📄 PDF Abstract BibTeX arXiv:2312.07399

Code (1)

ktio89/clinicalcot 공식 구현

Tasks

DiagnosticReading Comprehension

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Focus 설명 없음

Similar Papers 제목 키워드 기반

ProxyThinker: Test-Time Guidance through Small Visual Reasoners

2025-05-30 · Zilin Xiao, Jaywon Koo, Siru Ouyang, Jefferson Hernandez 외

Recent advancements in reinforcement learning with verifiable rewards have pushed the boundaries of the visual reasoning capabilities in large vision-language models (LVLMs). However, training LVLMs with reinforcement fi…

Visual Reasoning

Large Language Models are Contrastive Reasoners

2024-03-13 · Liang Yao

Prompting methods play a crucial role in enhancing the capabilities of pre-trained large language models (LLMs). We explore how contrastive prompting (CP) significantly improves the ability of large language models to pe…

GSM8K

Making Large Language Models Better Reasoners with Step-Aware Verifier

2022-06-06 · Yifei Li, Zeqi Lin, Shizhuo Zhang, Qiang Fu 외

Few-shot learning is a challenging task that requires language models to generalize from limited examples. Large language models like GPT-3 and PaLM have made impressive progress in this area, but they still face difficu…

Arithmetic ReasoningFew-Shot LearningGSM8KLanguage Modeling+1

Program-Aided Reasoners (better) Know What They Know

2023-11-16 · Anubha Kabra, Sanketh Rangreji, Yash Mathur, Aman Madaan 외

Prior work shows that program-aided reasoning, in which large language models (LLMs) are combined with programs written in programming languages such as Python, can significantly improve accuracy on various reasoning tas…

Diversity

Large Language Models are few(1)-shot Table Reasoners

2022-10-13 · Wenhu Chen

Recent literature has shown that large language models (LLMs) are generally excellent few-shot reasoners to solve text reasoning tasks. However, the capability of LLMs on table reasoning tasks is yet to be explored. In t…

Fact VerificationIn-Context Learning