paper-with-me

홈 › Papers

COPER: Continuous Patient State Perceiver

2022-08-05 · Vinod Kumar Chauhan, Anshul Thakur, Odhran O'Donoghue, David A. Clifton

In electronic health records (EHRs), irregular time-series (ITS) occur naturally due to patient health dynamics, reflected by irregular hospital visits, diseases/conditions and the necessity to measure different vitals signs at each visit etc. ITS present challenges in training machine learning algorithms which mostly are built on assumption of coherent fixed dimensional feature space. In this paper, we propose a novel COntinuous patient state PERceiver model, called COPER, to cope with ITS in EHRs. COPER uses Perceiver model and the concept of neural ordinary differential equations (ODEs) to learn the continuous time dynamics of patient state, i.e., continuity of input space and continuity of output space. The neural ODEs help COPER to generate regular time-series to feed to Perceiver model which has the capability to handle multi-modality large-scale inputs. To evaluate the performance of the proposed model, we use in-hospital mortality prediction task on MIMIC-III dataset and carefully design experiments to study irregularity. The results are compared with the baselines which prove the efficacy of the proposed model.

📄 PDF Abstract BibTeX arXiv:2208.03196

Code (1)

jmdvinodjmd/coper 공식 구현 pytorch

Tasks

Irregular Time SeriesMortality PredictionTime SeriesTime Series Analysis

Similar Papers 제목 키워드 기반

Uncertainty-Aware Perceiver

2024-02-04 · EuiYul Song

The Perceiver makes few architectural assumptions about the relationship among its inputs with quadratic scalability on its memory and computation time. Indeed, the Perceiver model outpaces or is competitive with ResNet-…

Graph Perceiver IO: A General Architecture for Graph Structured Data

2022-09-14 · Seyun Bae, Hoyoon Byun, Changdae Oh, Yoon-Sik Cho 외

Multimodal machine learning has been widely studied for the development of general intelligence. Recently, the remarkable multimodal algorithms, the Perceiver and Perceiver IO, show competitive results for diverse datase…

Graph ClassificationLink PredictionNode Classification

Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention

2022-11-21 · Zineng Tang, Jaemin Cho, Jie Lei, Mohit Bansal

We present Perceiver-VL, a vision-and-language framework that efficiently handles high-dimensional multimodal inputs such as long videos and text. Powered by the iterative latent cross-attention of Perceiver, our framewo…

Cross-Modal RetrievalLanguage ModelingLanguage ModellingRetrieval

Multitrack Music Transcription with a Time-Frequency Perceiver

2023-06-19 · Wei-Tsung Lu, Ju-Chiang Wang, Yun-Ning Hung

Multitrack music transcription aims to transcribe a music audio input into the musical notes of multiple instruments simultaneously. It is a very challenging task that typically requires a more complex model to achieve s…

Multi-Task LearningMusic Transcription

Multi-Modal Perceiver Language Model for Outcome Prediction in Emergency Department

2023-04-03 · Sabri Boughorbel, Fethi Jarray, Abdulaziz Al Homaid, Rashid Niaz 외

Language modeling have shown impressive progress in generating compelling text with good accuracy and high semantic coherence. An interesting research direction is to augment these powerful models for specific applicatio…

Language ModelingLanguage Modelling