paper-with-me

홈 › Papers

Self-supervised Representation Learning on Electronic Health Records with Graph Kernel Infomax

2022-09-01 · Hao-Ren Yao, Nairen Cao, Katina Russell, Der-Chen Chang, Ophir Frieder, Jeremy Fineman

Learning Electronic Health Records (EHRs) representation is a preeminent yet under-discovered research topic. It benefits various clinical decision support applications, e.g., medication outcome prediction or patient similarity search. Current approaches focus on task-specific label supervision on vectorized sequential EHR, which is not applicable to large-scale unsupervised scenarios. Recently, contrastive learning shows great success on self-supervised representation learning problems. However, complex temporality often degrades the performance. We propose Graph Kernel Infomax, a self-supervised graph kernel learning approach on the graphical representation of EHR, to overcome the previous problems. Unlike the state-of-the-art, we do not change the graph structure to construct augmented views. Instead, we use Kernel Subspace Augmentation to embed nodes into two geometrically different manifold views. The entire framework is trained by contrasting nodes and graph representations on those two manifold views through the commonly used contrastive objectives. Empirically, using publicly available benchmark EHR datasets, our approach yields performance on clinical downstream tasks that exceeds the state-of-the-art. Theoretically, the variation on distance metrics naturally creates different views as data augmentation without changing graph structures.

📄 PDF Abstract BibTeX arXiv:2209.00655

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningData AugmentationRepresentation Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Learning Longitudinal Health Representations from EHR and Wearable Data

2026-01-18 · Yuanyun Zhang, Han Zhou, Li Feng, Yilin Hong 외 arxiv

Foundation models trained on electronic health records show strong performance on many clinical prediction tasks but are limited by sparse and irregular documentation. Wearable devices provide dense continuous physiologi…

The Taxonomies, Training, and Applications of Event Stream Modelling for Electronic Health Records

2026-03-14 · Mingcheng Zhu, Yu Liu, Zhiyao Luo, Tingting Zhu arxiv

The widespread adoption of electronic health records (EHRs) enables the acquisition of heterogeneous clinical data, spanning lab tests, vital signs, medications, and procedures, which offer transformative potential for a…

Enhancing the prediction of disease outcomes using electronic health records and pretrained deep learning models

2022-12-22 · Zhichao Yang, Weisong Liu, Dan Berlowitz, Hong Yu

Question: Can an encoder-decoder architecture pretrained on a large dataset of longitudinal electronic health records improves patient outcome predictions? Findings: In this prognostic study of 6.8 million patients, our …

DecoderDenoisingPrediction

SANSformers: Self-Supervised Forecasting in Electronic Health Records with Attention-Free Models

2021-08-31 · Yogesh Kumar, Alexander Ilin, Henri Salo, Sangita Kulathinal 외

Despite the proven effectiveness of Transformer neural networks across multiple domains, their performance with Electronic Health Records (EHR) can be nuanced. The unique, multidimensional sequential nature of EHR data c…

Multi-Task LearningTransfer Learning

Med7: a transferable clinical natural language processing model for electronic health records

2020-03-03 · Andrey Kormilitzin, Nemanja Vaci, Qiang Liu, Alejo Nevado-Holgado

The field of clinical natural language processing has been advanced significantly since the introduction of deep learning models. The self-supervised representation learning and the transfer learning paradigm became the …

Medical Named Entity Recognitionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+3