Paging Dr. GPT: Extracting Information from Clinical Notes to Enhance Patient Predictions
There is a long history of building predictive models in healthcare using tabular data from electronic medical records. However, these models fail to extract the information found in unstructured clinical notes, which document diagnosis, treatment, progress, medications, and care plans. In this study, we investigate how answers generated by GPT-4o-mini (ChatGPT) to simple clinical questions about patients, when given access to the patient's discharge summary, can support patient-level mortality prediction. Using data from 14,011 first-time admissions to the Coronary Care or Cardiovascular Intensive Care Units in the MIMIC-IV Note dataset, we implement a transparent framework that uses GPT responses as input features in logistic regression models. Our findings demonstrate that GPT-based models alone can outperform models trained on standard tabular data, and that combining both sources of information yields even greater predictive power, increasing AUC by an average of 5.1 percentage points and increasing positive predictive value by 29.9 percent for the highest-risk decile. These results highlight the value of integrating large language models (LLMs) into clinical prediction tasks and underscore the broader potential for using LLMs in any domain where unstructured text data remains an underutilized resource.
Code (0)
등록된 구현이 없습니다.
Tasks
Mortality PredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Artificial Intelligence in Extracting Diagnostic Data from Dental Records
This research addresses the issue of missing structured data in dental records by extracting diagnostic information from unstructured text. The updated periodontology classification system's complexity has increased inco…
DiagnosticPaging with Succinct Predictions
Paging is a prototypical problem in the area of online algorithms. It has also played a central role in the development of learning-augmented algorithms -- a recent line of research that aims to ameliorate the shortcomin…
Impact of Large Language Model Assistance on Patients Reading Clinical Notes: A Mixed-Methods Study
Large language models (LLMs) have immense potential to make information more accessible, particularly in medicine, where complex medical jargon can hinder patient comprehension of clinical notes. We developed a patient-f…
Action UnderstandingLanguage ModelingLanguage ModellingLarge Language ModelQuestion-Answering System Extracts Information on Injection Drug Use from Clinical Notes
Background: Injection drug use (IDU) is a dangerous health behavior that increases mortality and morbidity. Identifying IDU early and initiating harm reduction interventions can benefit individuals at risk. However, extr…
Question AnsweringA Marker-based Neural Network System for Extracting Social Determinants of Health
Objective. The impact of social determinants of health (SDoH) on patients' healthcare quality and the disparity is well-known. Many SDoH items are not coded in structured forms in electronic health records. These items a…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+3