paper-with-me

홈 › Papers

EMIT- Event-Based Masked Auto Encoding for Irregular Time Series

2024-09-25 · Hrishikesh Patel, Ruihong Qiu, Adam Irwin, Shazia Sadiq, Sen Wang

Irregular time series, where data points are recorded at uneven intervals, are prevalent in healthcare settings, such as emergency wards where vital signs and laboratory results are captured at varying times. This variability, which reflects critical fluctuations in patient health, is essential for informed clinical decision-making. Existing self-supervised learning research on irregular time series often relies on generic pretext tasks like forecasting, which may not fully utilise the signal provided by irregular time series. There is a significant need for specialised pretext tasks designed for the characteristics of irregular time series to enhance model performance and robustness, especially in scenarios with limited data availability. This paper proposes a novel pretraining framework, EMIT, an event-based masking for irregular time series. EMIT focuses on masking-based reconstruction in the latent space, selecting masking points based on the rate of change in the data. This method preserves the natural variability and timing of measurements while enhancing the model's ability to process irregular intervals without losing essential information. Extensive experiments on the MIMIC-III and PhysioNet Challenge datasets demonstrate the superior performance of our event-based masking strategy. The code has been released at https://github.com/hrishi-ds/EMIT.

📄 PDF Abstract BibTeX arXiv:2409.16554

Code (1)

hrishi-ds/EMIT 공식 구현 tf

Tasks

Decision MakingIrregular Time SeriesSelf-Supervised LearningTime Series

Similar Papers 제목 키워드 기반

How Asynchronous Events Encode Video

2022-06-09 · Karen Adam, Adam Scholefield, Martin Vetterli

As event-based sensing gains in popularity, theoretical understanding is needed to harness this technology's potential. Instead of recording video by capturing frames, event-based cameras have sensors that emit events wh…

Event-based vision

Learning Representations from Incomplete EHR Data with Dual-Masked Autoencoding

2026-02-16 · Xiao Xiang, David Restrepo, Hyewon Jeong, Yugang Jia 외 arxiv

Learning from electronic health records (EHRs) time series is challenging due to irregular sam- pling, heterogeneous missingness, and the resulting sparsity of observations. Prior self-supervised meth- ods either impute …

FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimation

2023-03-02 · CVPR 2023 1 · Xiaoyu Shi, Zhaoyang Huang, Dasong Li, Manyuan Zhang 외

FlowFormer introduces a transformer architecture into optical flow estimation and achieves state-of-the-art performance. The core component of FlowFormer is the transformer-based cost-volume encoder. Inspired by the rece…

Optical Flow Estimation

Masked Autoencoders for Point Cloud Self-supervised Learning

2022-03-13 · Yatian Pang, Wenxiao Wang, Francis E. H. Tay, Wei Liu 외

As a promising scheme of self-supervised learning, masked autoencoding has significantly advanced natural language processing and computer vision. Inspired by this, we propose a neat scheme of masked autoencoders for poi…

3D Part Segmentation3D Point Cloud ClassificationFew-Shot 3D Point Cloud ClassificationFew-Shot Learning+1

Diffusion Autoencoders with Perceivers for Long, Irregular and Multimodal Astronomical Sequences

2025-10-23 · Yunyi Shen, Alexander Gagliano arxiv

Self-supervised learning has become a central strategy for representation learning, but the majority of architectures used for encoding data have only been validated on regularly-sampled inputs such as images, audios. an…

Self-Supervised LearningRepresentation Learning