paper-with-me

홈 › Papers

TAPER: Time-Aware Patient EHR Representation

2019-08-11 · Sajad Darabi, Mohammad Kachuee, Shayan Fazeli, Majid Sarrafzadeh

Effective representation learning of electronic health records is a challenging task and is becoming more important as the availability of such data is becoming pervasive. The data contained in these records are irregular and contain multiple modalities such as notes, and medical codes. They are preempted by medical conditions the patient may have, and are typically jotted down by medical staff. Accompanying codes are notes containing valuable information about patients beyond the structured information contained in electronic health records. We use transformer networks and the recently proposed BERT language model to embed these data streams into a unified vector representation. The presented approach effectively encodes a patient's visit data into a single distributed representation, which can be used for downstream tasks. Our model demonstrates superior performance and generalization on mortality, readmission and length of stay tasks using the publicly available MIMIC-III ICU dataset. Code avaialble at https://github.com/sajaddarabi/TAPER-EHR

📄 PDF Abstract BibTeX arXiv:1908.03971

Code (2)

sajaddarabi/TAPER 공식 구현 pytorch
sajaddarabi/TAPER-EHR 공식 구현 pytorch

Tasks

Language ModelingLanguage ModellingRepresentation Learning

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Weight Decay 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

Tapering Analysis of Airways with Bronchiectasis

2019-09-14 · Kin Quan, Rebecca J. Shipley, Ryutaro Tanno, Graeme McPhillips 외

Bronchiectasis is the permanent dilation of airways. Patients with the disease can suffer recurrent exacerbations, reducing their quality of life. The gold standard to diagnose and monitor bronchiectasis is accomplished …

Computed Tomography (CT)

Evaluation of automated airway morphological quantification for assessing fibrosing lung disease

2021-11-19 · Ashkan Pakzad, Wing Keung Cheung, Kin Quan, Nesrin Mogulkoc 외

Abnormal airway dilatation, termed traction bronchiectasis, is a typical feature of idiopathic pulmonary fibrosis (IPF). Volumetric computed tomography (CT) imaging captures the loss of normal airway tapering in IPF. We …

Computed Tomography (CT)

Dual mechanism of Anti-Seizure Medications in controlling seizure activity

2025-04-02 · Guillermo M. Besne, Emmanuel Molefi, Sarah J. Gascoigne, Nathan Evans 외

Background: Anti-seizure medications (ASMs) can reduce seizure duration, but their precise modes of action are unclear. Specifically, it is unknown whether ASMs shorten seizures by simply compressing existing seizure act…

EEG

Gated Normalization Removal and Scale Anchoring in Pre-Norm Transformers

2026-02-11 · Andrei Kanavalau, Carmen Amo Alonso, Sanjay Lall arxiv

Normalization layers are standard in transformers, but it is not clear whether their sample-dependent computations are necessary throughout both training and inference. This work develops a gated normalization-removal ap…

Reproducibility of an airway tapering measurement in CT with application to bronchiectasis

2019-09-16 · Kin Quan, Ryutaro Tanno, Rebecca J. Shipley, Jeremy S. Brown 외

Purpose: This paper proposes a pipeline to acquire a scalar tapering measurement from the carina to the most distal point of an individual airway visible on CT. We show the applicability of using tapering measurements on…