paper-with-me

홈 › Papers

CheX-GPT: Harnessing Large Language Models for Enhanced Chest X-ray Report Labeling

2024-01-21 · Jawook Gu, Kihyun You, Han-Cheol Cho, Jiho Kim, Eun Kyoung Hong, Byungseok Roh

Free-text radiology reports present a rich data source for various medical tasks, but effectively labeling these texts remains challenging. Traditional rule-based labeling methods fall short of capturing the nuances of diverse free-text patterns. Moreover, models using expert-annotated data are limited by data scarcity and pre-defined classes, impacting their performance, flexibility and scalability. To address these issues, our study offers three main contributions: 1) We demonstrate the potential of GPT as an adept labeler using carefully designed prompts. 2) Utilizing only the data labeled by GPT, we trained a BERT-based labeler, CheX-GPT, which operates faster and more efficiently than its GPT counterpart. 3) To benchmark labeler performance, we introduced a publicly available expert-annotated test set, MIMIC-500, comprising 500 cases from the MIMIC validation set. Our findings demonstrate that CheX-GPT not only excels in labeling accuracy over existing models, but also showcases superior efficiency, flexibility, and scalability, supported by our introduction of the MIMIC-500 dataset for robust benchmarking. Code and models are available at https://github.com/Soombit-ai/CheXGPT.

📄 PDF Abstract BibTeX arXiv:2401.11505

Code (2)

kakaobrain/chexgpt 공식 구현 pytorch
soombit-ai/chexgpt 공식 구현 pytorch

Tasks

Benchmarking

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Adam 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Effect of Radiology Report Labeler Quality on Deep Learning Models for Chest X-Ray Interpretation

2021-04-01 · Saahil Jain, Akshay Smit, Andrew Y. Ng, Pranav Rajpurkar

Although deep learning models for chest X-ray interpretation are commonly trained on labels generated by automatic radiology report labelers, the impact of improvements in report labeling on the performance of chest X-ra…

ClassificationGeneral Classificationimage-classificationImage Classification+1

CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning

2017-11-14 · Pranav Rajpurkar, Jeremy Irvin, Kaylie Zhu, Brandon Yang 외

We develop an algorithm that can detect pneumonia from chest X-rays at a level exceeding practicing radiologists. Our algorithm, CheXNet, is a 121-layer convolutional neural network trained on ChestX-ray14, currently the…

Pneumonia Detection

CheXT: Knowledge-Guided Cross-Attention Transformer for Abnormality Classification and Localization in Chest X-rays

2021-09-29 · Yan Han, Ying Ding, Ahmed Tewfik, Yifan Peng 외

Classical chest X-ray analysis has designed radiomic features to indicate the characteristics of abnormality of the chest X-rays. However, extracting reliable radiomic features heavily hinges on pathology localization, w…

A Vision-Language Foundation Model to Enhance Efficiency of Chest X-ray Interpretation

2024-01-22 · Zhihong Chen, Maya Varma, Justin Xu, Magdalini Paschali 외

Over 1.4 billion chest X-rays (CXRs) are performed annually due to their cost-effectiveness as an initial diagnostic test. This scale of radiological studies provides a significant opportunity to streamline CXR interpret…

BenchmarkingDiagnosticFairnessLanguage Modelling+1

Rethinking Annotation Granularity for Overcoming Shortcuts in Deep Learning-based Radiograph Diagnosis: A Multicenter Study

2021-04-21 · Luyang Luo, Hao Chen, Yongjie Xiao, Yanning Zhou 외

Two DL models were developed using radiograph-level annotations (yes or no disease) and fine-grained lesion-level annotations (lesion bounding boxes), respectively named CheXNet and CheXDet. The models' internal classifi…

ClassificationDecision MakingGeneral ClassificationLesion Detection+1