Evaluating the Portability of an NLP System for Processing Echocardiograms: A Retrospective, Multi-site Observational Study
While natural language processing (NLP) of unstructured clinical narratives holds the potential for patient care and clinical research, portability of NLP approaches across multiple sites remains a major challenge. This study investigated the portability of an NLP system developed initially at the Department of Veterans Affairs (VA) to extract 27 key cardiac concepts from free-text or semi-structured echocardiograms from three academic medical centers: Weill Cornell Medicine, Mayo Clinic and Northwestern Medicine. While the NLP system showed high precision and recall measurements for four target concepts (aortic valve regurgitation, left atrium size at end systole, mitral valve regurgitation, tricuspid valve regurgitation) across all sites, we found moderate or poor results for the remaining concepts and the NLP system performance varied between individual sites.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Echocardiogram Foundation Model -- Application 1: Estimating Ejection Fraction
Cardiovascular diseases stand as the primary global cause of mortality. Among the various imaging techniques available for visualising the heart and evaluating its function, echocardiograms emerge as the preferred choice…
modelSelf-Supervised LearningTraining-Free Condition Video Diffusion Models for single frame Spatial-Semantic Echocardiogram Synthesis
Conditional video diffusion models (CDM) have shown promising results for video synthesis, potentially enabling the generation of realistic echocardiograms to address the problem of data scarcity. However, current CDMs r…
Data AugmentationDomain AdaptationSegmentationInterpretable Prediction of Pulmonary Hypertension in Newborns using Echocardiograms
Pulmonary hypertension (PH) in newborns and infants is a complex condition associated with several pulmonary, cardiac, and systemic diseases contributing to morbidity and mortality. Therefore, accurate and early detectio…
DiagnosticManagementPredictionseverity predictionEstimation of mitral valve hinge point coordinates -- deep neural net for echocardiogram segmentation
Cardiac image segmentation is a powerful tool in regard to diagnostics and treatment of cardiovascular diseases. Purely feature-based detection of anatomical structures like the mitral valve is a laborious task due to sp…
Feature EngineeringGPUImage SegmentationMedical Image Segmentation+1Switching Contexts: Transportability Measures for NLP
This paper explores the topic of transportability, as a sub-area of generalisability. By proposing the utilisation of metrics based on well-established statistics, we are able to estimate the change in performance of NLP…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Natural Language Inference