paper-with-me

홈 › Papers

PULSE-ICU: A Pretrained Unified Long-Sequence Encoder for Multi-task Prediction in Intensive Care Units

2025-11-27 · Sejeong Jang, Joo Heung Yoon, Hyo Kyung Lee arxiv

Intensive care unit (ICU) data are highly irregular, heterogeneous, and temporally fragmented, posing challenges for generalizable clinical prediction. We present PULSE-ICU, a self-supervised foundation model that learns event-level ICU representations from large-scale EHR sequences without resampling or manual feature engineering. A unified embedding module encodes event identity, continuous values, units, and temporal attributes, while a Longformer-based encoder enables efficient modeling of long trajectories. PULSE-ICU was fine-tuned across 18 prediction tasks, including mortality, intervention forecasting, and phenotype identification, achieving strong performance across task types. External validation on eICU, HiRID, and P12 showed substantial improvements with minimal fine-tuning, demonstrating robustness to domain shift and variable constraints. These findings suggest that foundation-style modeling can improve data efficiency and adaptability, providing a scalable framework for ICU decision support across diverse clinical environments.

📄 PDF Abstract BibTeX arXiv:2511.22199

Code (0)

등록된 구현이 없습니다.

Tasks

Feature Engineering

Similar Papers 제목 키워드 기반

Statistical reconstruction of pulse shapes from pulse streams

2023-02-06 · Marek W. Rupniewski

A short sample sequence of a finite-length pulse signal allows for its reconstruction only if the signal has a sparse representation in some basis. The recurrence of the pulse allows for a statistical approach to its rec…

Efficient Long-Text Understanding with Short-Text Models

2022-08-01 · Maor Ivgi, Uri Shaham, Jonathan Berant

Transformer-based pretrained language models (LMs) are ubiquitous across natural language understanding, but cannot be applied to long sequences such as stories, scientific articles and long documents, due to their quadr…

ArticlesDecoderLong-range modelingNatural Language Understanding

A Temporal Encoder-Decoder Approach to Extracting Blood Volume Pulse Signal Morphology from Face Videos

2023-06-01 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshop 2023 6 · Fulan Li, Surendrabikram Thapa, Shreyas Bhat, Abhijit Sarkar 외

This paper considers methods for extracting blood volume pulse (BVP) representations from video of the human face. Whereas most previous systems have been concerned with estimating vital signs such as average heart rate,…

Decoder

Enhancing the prediction of disease outcomes using electronic health records and pretrained deep learning models

2022-12-22 · Zhichao Yang, Weisong Liu, Dan Berlowitz, Hong Yu

Question: Can an encoder-decoder architecture pretrained on a large dataset of longitudinal electronic health records improves patient outcome predictions? Findings: In this prognostic study of 6.8 million patients, our …

DecoderDenoisingPrediction

UniVL: Unified Vision-Language Embedding for Spatially Grounded Contextual Image Generation

2026-05-20 · Jiayun Wang, Yu Wang, Weijie Gan, Zhenting Wang 외 arxiv

We introduce spatially grounded contextual image generation, a controllable image generation task that reframes the conditioning paradigm. Instead of supplying a reference image and a global text prompt through two separ…

Image Generation