Large Language Model Capabilities in Perioperative Risk Prediction and Prognostication
We investigate whether general-domain large language models such as GPT-4 Turbo can perform risk stratification and predict post-operative outcome measures using a description of the procedure and a patient's clinical notes derived from the electronic health record. We examine predictive performance on 8 different tasks: prediction of ASA Physical Status Classification, hospital admission, ICU admission, unplanned admission, hospital mortality, PACU Phase 1 duration, hospital duration, and ICU duration. Few-shot and chain-of-thought prompting improves predictive performance for several of the tasks. We achieve F1 scores of 0.50 for ASA Physical Status Classification, 0.81 for ICU admission, and 0.86 for hospital mortality. Performance on duration prediction tasks were universally poor across all prompt strategies. Current generation large language models can assist clinicians in perioperative risk stratification on classification tasks and produce high-quality natural language summaries and explanations.
Code (1)
Tasks
ClassificationICU AdmissionLanguage ModelingLanguage ModellingLarge Language ModelMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
The Foundational Capabilities of Large Language Models in Predicting Postoperative Risks Using Clinical Notes
Clinical notes recorded during a patient's perioperative journey holds immense informational value. Advances in large language models (LLMs) offer opportunities for bridging this gap. Using 84,875 pre-operative notes and…
Domain AdaptationMulti-Task LearningWord EmbeddingsSurgical Prediction with Interpretable Latent Representation
Given the risks and cost of surgeries, there has been significant interest in exploiting predictive models to improve perioperative care. However, due to the high dimensionality and noisiness of perioperative data, it is…
PredictionRepresentation LearningSURGENT: A Surgical Multi-Agent Assistance System Across the Perioperative Workflow
The intricate nature of modern surgical care necessitates intelligent systems that can synthesize extensive patient records, support collaborative decision-making, and provide transparent, auditable reasoning across the …
Deep Learning Approach for Predicting 30 Day Readmissions after Coronary Artery Bypass Graft Surgery
Hospital Readmissions within 30 days after discharge following Coronary Artery Bypass Graft (CABG) Surgery are substantial contributors to healthcare costs. Many predictive models were developed to identify risk factors …
BIG-bench Machine LearningSurvival AnalysisImproved Predictive Models for Acute Kidney Injury with IDEAs: Intraoperative Data Embedded Analytics
Acute kidney injury (AKI) is a common and serious complication after a surgery which is associated with morbidity and mortality. The majority of existing perioperative AKI risk score prediction models are limited in thei…
Time SeriesTime Series Analysis