paper-with-me

Papers

Compatible Transformer for Irregularly Sampled Multivariate Time Series

2023-10-17 · Yuxi Wei, Juntong Peng, Tong He, Chenxin Xu, Jian Zhang, Shirui Pan, Siheng Chen

To analyze multivariate time series, most previous methods assume regular subsampling of time series, where the interval between adjacent measurements and the number of samples remain unchanged. Practically, data collection systems could produce irregularly sampled time series due to sensor failures and interventions. However, existing methods designed for regularly sampled multivariate time series cannot directly handle irregularity owing to misalignment along both temporal and variate dimensions. To fill this gap, we propose Compatible Transformer (CoFormer), a transformer-based encoder to achieve comprehensive temporal-interaction feature learning for each individual sample in irregular multivariate time series. In CoFormer, we view each sample as a unique variate-time point and leverage intra-variate/inter-variate attentions to learn sample-wise temporal/interaction features based on intra-variate/inter-variate neighbors. With CoFormer as the core, we can analyze irregularly sampled multivariate time series for many downstream tasks, including classification and prediction. We conduct extensive experiments on 3 real-world datasets and validate that the proposed CoFormer significantly and consistently outperforms existing methods.

📄 PDF Abstract BibTeX arXiv:2310.11022

Code (1)

mediabrain-sjtu/coformer 공식 구현 pytorch

Tasks

Time Series

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Interpolation-Prediction Networks for Irregularly Sampled Time Series

2019-09-13 · ICLR 2019 5 · Satya Narayan Shukla, Benjamin M. Marlin

In this paper, we present a new deep learning architecture for addressing the problem of supervised learning with sparse and irregularly sampled multivariate time series. The architecture is based on the use of a semi-pa…

Deep LearningLength-of-Stay predictionMortality PredictionPrediction+3

Forecasting in multivariate irregularly sampled time series with missing values

2020-04-06 · Shivam Srivastava, Prithviraj Sen, Berthold Reinwald

Sparse and irregularly sampled multivariate time series are common in clinical, climate, financial and many other domains. Most recent approaches focus on classification, regression or forecasting tasks on such data. In …

General ClassificationIrregular Time SeriesMissing Valuesregression+2

Learning from Irregularly-Sampled Time Series: A Missing Data Perspective

2020-08-17 · ICML 2020 1 · Steven Cheng-Xian Li, Benjamin M. Marlin

Irregularly-sampled time series occur in many domains including healthcare. They can be challenging to model because they do not naturally yield a fixed-dimensional representation as required by many standard machine lea…

DecoderTime SeriesTime Series Analysis

MuSiCNet: A Gradual Coarse-to-Fine Framework for Irregularly Sampled Multivariate Time Series Analysis

2024-12-02 · Jiexi Liu, Meng Cao, Songcan Chen

Irregularly sampled multivariate time series (ISMTS) are prevalent in reality. Most existing methods treat ISMTS as synchronized regularly sampled time series with missing values, neglecting that the irregularities are p…

Contrastive LearningMissing ValuesPhilosophyRepresentation Learning+2

Graph-Guided Network for Irregularly Sampled Multivariate Time Series

2021-10-11 · ICLR 2022 4 · Xiang Zhang, Marko Zeman, Theodoros Tsiligkaridis, Marinka Zitnik

In many domains, including healthcare, biology, and climate science, time series are irregularly sampled with varying time intervals between successive readouts and different subsets of variables (sensors) observed at di…

Graph Neural NetworkTime SeriesTime Series Analysis