paper-with-me

홈 › Papers

LLM-MedQA: Enhancing Medical Question Answering through Case Studies in Large Language Models

2024-12-31 · Hang Yang, Hao Chen, Hui Guo, Yineng Chen, Ching-Sheng Lin, Shu Hu, Jinrong Hu, Xi Wu, Xin Wang

Accurate and efficient question-answering systems are essential for delivering high-quality patient care in the medical field. While Large Language Models (LLMs) have made remarkable strides across various domains, they continue to face significant challenges in medical question answering, particularly in understanding domain-specific terminologies and performing complex reasoning. These limitations undermine their effectiveness in critical medical applications. To address these issues, we propose a novel approach incorporating similar case generation within a multi-agent medical question-answering (MedQA) system. Specifically, we leverage the Llama3.1:70B model, a state-of-the-art LLM, in a multi-agent architecture to enhance performance on the MedQA dataset using zero-shot learning. Our method capitalizes on the model's inherent medical knowledge and reasoning capabilities, eliminating the need for additional training data. Experimental results show substantial performance gains over existing benchmark models, with improvements of 7% in both accuracy and F1-score across various medical QA tasks. Furthermore, we examine the model's interpretability and reliability in addressing complex medical queries. This research not only offers a robust solution for medical question answering but also establishes a foundation for broader applications of LLMs in the medical domain.

📄 PDF Abstract BibTeX arXiv:2501.05464

Code (0)

등록된 구현이 없습니다.

Tasks

Medical Question AnsweringMedQAQuestion AnsweringZero-Shot Learning

Similar Papers 제목 키워드 기반

PubMedQA: A Dataset for Biomedical Research Question Answering

2019-09-13 · IJCNLP 2019 11 · Qiao Jin, Bhuwan Dhingra, Zhengping Liu, William W. Cohen 외

We introduce PubMedQA, a novel biomedical question answering (QA) dataset collected from PubMed abstracts. The task of PubMedQA is to answer research questions with yes/no/maybe (e.g.: Do preoperative statins reduce atri…

Question Answering

Can Large Language Models Self-Correct in Medical Question Answering? An Exploratory Study

2026-03-31 · Zaifu Zhan, Mengyuan Cui, Rui Zhang arxiv

Large language models (LLMs) have achieved strong performance on medical question answering (medical QA), and chain-of-thought (CoT) prompting has further improved results by eliciting explicit intermediate reasoning; me…

Question Answering

CMU LiveMedQA at TREC 2017 LiveQA: A Consumer Health Question Answering System

2017-11-15 · Yuan Yang, Jingcheng Yu, Ye Hu, Xiaoyao Xu 외

In this paper, we present LiveMedQA, a question answering system that is optimized for consumer health question. On top of the general QA system pipeline, we introduce several new features that aim to exploit domain-spec…

Answer GenerationGeneral ClassificationQuestion AnsweringRetrieval+2

What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Exams

2020-09-28 · Di Jin, Eileen Pan, Nassim Oufattole, Wei-Hung Weng 외

Open domain question answering (OpenQA) tasks have been recently attracting more and more attention from the natural language processing (NLP) community. In this work, we present the first free-form multiple-choice OpenQ…

MedQAMultiple-choiceOpen-Domain Question AnsweringQuestion Answering+1

Medical Exam Question Answering with Large-scale Reading Comprehension

2018-02-28 · Xiao Zhang, Ji Wu, ZhiYang He, Xien Liu 외

Reading and understanding text is one important component in computer aided diagnosis in clinical medicine, also being a major research problem in the field of NLP. In this work, we introduce a question-answering task ca…

MedQAQuestion AnsweringReading Comprehension