paper-with-me

홈 › Papers

Multimodal Fusion of Echocardiography and Electronic Health Records for the Detection of Cardiac Amyloidosis

2024-04-17 · Zishun Feng, Joseph A. Sivak, Ashok K. Krishnamurthy

Cardiac amyloidosis, a rare and highly morbid condition, presents significant challenges for detection through echocardiography. Recently, there has been a surge in proposing machine-learning algorithms to identify cardiac amyloidosis, with the majority being imaging-based deep-learning approaches that require extensive data. In this study, we introduce a novel transformer-based multimodal fusion algorithm that leverages information from both imaging and electronic health records. Specifically, our approach utilizes echocardiography videos from both the parasternal long-axis (PLAX) view and the apical 4-chamber (A4C) view along with patients' demographic data, laboratory tests, and cardiac metrics to predict the probability of cardiac amyloidosis. We evaluated our method using 5-fold cross-validation on a dataset comprising 41 patients and achieved an Area Under the Receiver Operating Characteristic curve (AUROC) of 0.94. The experimental results demonstrate that our approach can achieve competitive results with a significantly smaller dataset compared to prior imaging-based methods that required data from thousands of patients. This underscores the potential of leveraging multimodal data to enhance diagnostic accuracy in the identification of complex cardiac conditions such as cardiac amyloidosis.

📄 PDF Abstract BibTeX arXiv:2404.11058

Code (0)

등록된 구현이 없습니다.

Tasks

Diagnostic

Similar Papers 제목 키워드 기반

Artificial Intelligence-Based Methods for Fusion of Electronic Health Records and Imaging Data

2022-10-23 · Farida Mohsen, Hazrat Ali, Nady El Hajj, Zubair Shah

Healthcare data are inherently multimodal, including electronic health records (EHR), medical images, and multi-omics data. Combining these multimodal data sources contributes to a better understanding of human health an…

Learning Longitudinal Health Representations from EHR and Wearable Data

2026-01-18 · Yuanyun Zhang, Han Zhou, Li Feng, Yilin Hong 외 arxiv

Foundation models trained on electronic health records show strong performance on many clinical prediction tasks but are limited by sparse and irregular documentation. Wearable devices provide dense continuous physiologi…

Improving Medical Predictions by Irregular Multimodal Electronic Health Records Modeling

2022-10-18 · Xinlu Zhang, Shiyang Li, Zhiyu Chen, Xifeng Yan 외

Health conditions among patients in intensive care units (ICUs) are monitored via electronic health records (EHRs), composed of numerical time series and lengthy clinical note sequences, both taken at irregular time inte…

ImputationIrregular Time SeriesTime SeriesTime Series Analysis

Machine Learning for Multimodal Electronic Health Records-based Research: Challenges and Perspectives

2021-11-09 · Ziyi Liu, JiaQi Zhang, Yongshuai Hou, Xinran Zhang 외

Background: Electronic Health Records (EHRs) contain rich information of patients' health history, which usually include both structured and unstructured data. There have been many studies focusing on distilling valuable…

ArticlesBIG-bench Machine Learning

MUFASA: Multimodal Fusion Architecture Search for Electronic Health Records

2021-02-03 · Zhen Xu, David R. So, Andrew M. Dai

One important challenge of applying deep learning to electronic health records (EHR) is the complexity of their multimodal structure. EHR usually contains a mixture of structured (codes) and unstructured (free-text) data…

Neural Architecture Search