paper-with-me

Papers

Predictive Modeling with Temporal Graphical Representation on Electronic Health Records

2024-05-07 · Jiayuan Chen, Changchang Yin, Yuanlong Wang, Ping Zhang

Deep learning-based predictive models, leveraging Electronic Health Records (EHR), are receiving increasing attention in healthcare. An effective representation of a patient's EHR should hierarchically encompass both the temporal relationships between historical visits and medical events, and the inherent structural information within these elements. Existing patient representation methods can be roughly categorized into sequential representation and graphical representation. The sequential representation methods focus only on the temporal relationships among longitudinal visits. On the other hand, the graphical representation approaches, while adept at extracting the graph-structured relationships between various medical events, fall short in effectively integrate temporal information. To capture both types of information, we model a patient's EHR as a novel temporal heterogeneous graph. This graph includes historical visits nodes and medical events nodes. It propagates structured information from medical event nodes to visit nodes and utilizes time-aware visit nodes to capture changes in the patient's health status. Furthermore, we introduce a novel temporal graph transformer (TRANS) that integrates temporal edge features, global positional encoding, and local structural encoding into heterogeneous graph convolution, capturing both temporal and structural information. We validate the effectiveness of TRANS through extensive experiments on three real-world datasets. The results show that our proposed approach achieves state-of-the-art performance.

📄 PDF Abstract BibTeX arXiv:2405.03943

Code (1)

the-real-jerrychen/trans 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
LapEigen 설명 없음
Multi-Head Attention 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Predictive Multimodal Modeling of Diagnoses and Treatments in EHR

2025-08-14 · Cindy Shih-Ting Huang, Clarence Boon Liang Ng, Marek Rei arxiv

While the ICD code assignment problem has been widely studied, most works have focused on post-discharge document classification. Models for early forecasting of this information could be used for identifying health risk…

Document Classification

Medical Concept Representation Learning from Electronic Health Records and its Application on Heart Failure Prediction

2016-02-11 · Edward Choi, Andy Schuetz, Walter F. Stewart, Jimeng Sun

Objective: To transform heterogeneous clinical data from electronic health records into clinically meaningful constructed features using data driven method that rely, in part, on temporal relations among data. Materials …

Representation Learning

Temporal Poisson Square Root Graphical Models

2020-05-12 · ICML 2018 7 · Sinong Geng, Zhaobin Kuang, Peggy Peissig, David Page

We propose temporal Poisson square root graphical models (TPSQRs), a generalization of Poisson square root graphical models (PSQRs) specifically designed for modeling longitudinal event data. By estimating the temporal r…

Geo-Adaptive Deep Spatio-Temporal predictive modeling for human mobility

2022-11-27 · Syed Mohammed Arshad Zaidi, Varun Chandola, EunHye Yoo

Deep learning approaches for spatio-temporal prediction problems such as crowd-flow prediction assumes data to be of fixed and regular shaped tensor and face challenges of handling irregular, sparse data tensor. This pos…

Deep Learning

Unifying Heterogeneous Electronic Health Records Systems via Text-Based Code Embedding

2021-08-08 · Kyunghoon Hur, Jiyoung Lee, JungWoo Oh, Wesley Price 외

Substantial increase in the use of Electronic Health Records (EHRs) has opened new frontiers for predictive healthcare. However, while EHR systems are nearly ubiquitous, they lack a unified code system for representing m…

Representation LearningTransfer Learning