paper-with-me

홈 › Papers

MedConceptsQA: Open Source Medical Concepts QA Benchmark

2024-05-12 · Ofir Ben Shoham, Nadav Rappoport

We present MedConceptsQA, a dedicated open source benchmark for medical concepts question answering. The benchmark comprises of questions of various medical concepts across different vocabularies: diagnoses, procedures, and drugs. The questions are categorized into three levels of difficulty: easy, medium, and hard. We conducted evaluations of the benchmark using various Large Language Models. Our findings show that pre-trained clinical Large Language Models achieved accuracy levels close to random guessing on this benchmark, despite being pre-trained on medical data. However, GPT-4 achieves an absolute average improvement of nearly 27%-37% (27% for zero-shot learning and 37% for few-shot learning) when compared to clinical Large Language Models. Our benchmark serves as a valuable resource for evaluating the understanding and reasoning of medical concepts by Large Language Models. Our benchmark is available at https://huggingface.co/datasets/ofir408/MedConceptsQA

📄 PDF Abstract BibTeX arXiv:2405.07348

Code (1)

nadavlab/MedConceptsQA 공식 구현 pytorch

Tasks

Few-Shot LearningQuestion AnsweringZero-Shot Learning

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Position-Wise Feed-Forward Layer 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Introduction to Medical Image Registration with DeepReg, Between Old and New

2020-08-29 · N. Montana Brown, Y. Fu, S. U. Saeed, A. Casamitjana 외

This document outlines a tutorial to get started with medical image registration using the open-source package DeepReg. The basic concepts of medical image registration are discussed, linking classical methods to newer m…

Deep LearningImage RegistrationMedical Image Registration

Biomedical Concept Relatedness -- A large EHR-based benchmark

2020-10-30 · COLING 2020 8 · Claudia Schulz, Josh Levy-Kramer, Camille Van Assel, Miklos Kepes 외

A promising application of AI to healthcare is the retrieval of information from electronic health records (EHRs), e.g. to aid clinicians in finding relevant information for a consultation or to recruit suitable patients…

Retrieval

The Parallel Distributed Image Search Engine (ParaDISE)

2017-01-19 · Markonis Dimitrios, Schaer Roger, de Herrera Alba García Seco, Müller Henning

Image retrieval is a complex task that differs according to the context and the user requirements in any specific field, for example in a medical environment. Search by text is often not possible or optimal and retrieval…

Image RetrievalMedical Image RetrievalRetrieval

Clinical Concept Embeddings Learned from Massive Sources of Multimodal Medical Data

2018-04-04 · Andrew L. Beam, Benjamin Kompa, Allen Schmaltz, Inbar Fried 외

Word embeddings are a popular approach to unsupervised learning of word relationships that are widely used in natural language processing. In this article, we present a new set of embeddings for medical concepts learned …

ArticlesWord Embeddings

Improving Broad-Coverage Medical Entity Linking with Semantic Type Prediction and Large-Scale Datasets

2020-05-01 · Shikhar Vashishth, Denis Newman-Griffis, Rishabh Joshi, Ritam Dutt 외

Medical entity linking is the task of identifying and standardizing medical concepts referred to in an unstructured text. Most of the existing methods adopt a three-step approach of (1) detecting mentions, (2) generating…

Entity DisambiguationEntity LinkingTransfer LearningType prediction