paper-with-me

홈 › Papers

MPLite: Multi-Aspect Pretraining for Mining Clinical Health Records

2024-11-17 · Eric Yang, Pengfei Hu, Xiaoxue Han, Yue Ning

The adoption of digital systems in healthcare has resulted in the accumulation of vast electronic health records (EHRs), offering valuable data for machine learning methods to predict patient health outcomes. However, single-visit records of patients are often neglected in the training process due to the lack of annotations of next-visit information, thereby limiting the predictive and expressive power of machine learning models. In this paper, we present a novel framework MPLite that utilizes Multi-aspect Pretraining with Lab results through a light-weight neural network to enhance medical concept representation and predict future health outcomes of individuals. By incorporating both structured medical data and additional information from lab results, our approach fully leverages patient admission records. We design a pretraining module that predicts medical codes based on lab results, ensuring robust prediction by fusing multiple aspects of features. Our experimental evaluation using both MIMIC-III and MIMIC-IV datasets demonstrates improvements over existing models in diagnosis prediction and heart failure prediction tasks, achieving a higher weighted-F1 and recall with MPLite. This work reveals the potential of integrating diverse aspects of data to advance predictive modeling in healthcare.

📄 PDF Abstract BibTeX arXiv:2411.11161

Code (0)

등록된 구현이 없습니다.

Tasks

Prediction

Similar Papers 제목 키워드 기반

SMPLitex: A Generative Model and Dataset for 3D Human Texture Estimation from Single Image

2023-09-04 · Dan Casas, Marc Comino-Trinidad

We propose SMPLitex, a method for estimating and manipulating the complete 3D appearance of humans captured from a single image. SMPLitex builds upon the recently proposed generative models for 2D images, and extends the…

MAKE: Multi-Aspect Knowledge-Enhanced Vision-Language Pretraining for Zero-shot Dermatological Assessment

2025-05-14 · Siyuan Yan, Xieji Li, Ming Hu, Yiwen Jiang 외

Dermatological diagnosis represents a complex multimodal challenge that requires integrating visual features with specialized clinical knowledge. While vision-language pretraining (VLP) has advanced medical AI, its effec…

Clinical KnowledgeContrastive LearningCross-Modal Retrieval

Embedding And Clustering Your Data Can Improve Contrastive Pretraining

2024-07-26 · Luke Merrick

Recent studies of large-scale contrastive pretraining in the text embedding domain show that using single-source minibatches, rather than mixed-source minibatches, can substantially improve overall model accuracy. In thi…

ClusteringPassage RetrievalRetrieval

BioELECTRA:Pretrained Biomedical text Encoder using Discriminators

2021-06-11 · ACL Anthology 2021 6 · Kamal raj Kanakarajan, Bhuvana Kundumani, Malaikannan Sankarasubbu

Recent advancements in pretraining strategies in NLP have shown a significant improvement in the performance of models on various text mining tasks. We apply ‘replaced token detection’ pretraining technique proposed by E…

ArticlesLanguage ModelingLanguage ModellingMedical Named Entity Recognition+3

Spatial Transcriptomics as Images for Large-Scale Pretraining

2026-03-13 · Yishun Zhu, Jiaxin Qi, Jian Wang, Yuhua Zheng 외 arxiv

Spatial Transcriptomics (ST) profiles thousands of gene expression values at discrete spots with precise coordinates on tissue sections, preserving spatial context essential for clinical and pathological studies. With ri…