Deep Amortized Variational Inference for Multivariate Time Series Imputation with Latent Gaussian Process Models
Multivariate time series with missing values are common in areas such as healthcare and finance, and have grown in number and complexity over the years. This raises the question whether deep learning methodologies can outperform classical data imputation methods in this domain. However, naive applications of deep learning fall short in giving reliable confidence estimates and lack interpretability. We propose a new deep sequential latent variable model for dimensionality reduction and data imputation. Our modeling assumption is simple and interpretable: the high dimensional time series has a lower-dimensional representation which evolves smoothly in time according to a Gaussian process. The non-linear dimensionality reduction in the presence of missing data is achieved using a VAE approach with a novel structured variational approximation. We demonstrate that our approach outperforms several classical and deep learning-based data imputation methods on high-dimensional data from the domains of computer vision and healthcare, while additionally improving the smoothness of the imputations and providing interpretable uncertainty estimates.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningDimensionality ReductionImputationMissing ValuesMultivariate Time Series ImputationTime SeriesTime Series AnalysisVariational InferenceSimilar Papers 제목 키워드 기반
Amortized Control of Continuous State Space Feynman-Kac Model for Irregular Time Series
Many real-world datasets, such as healthcare, climate, and economics, are often collected as irregular time series, which poses challenges for accurate modeling. In this paper, we propose the Amortized Control of continu…
Computational EfficiencyIrregular Time SeriesRepresentation LearningTime Series+1Recursive Inference for Variational Autoencoders
Inference networks of traditional Variational Autoencoders (VAEs) are typically amortized, resulting in relatively inaccurate posterior approximation compared to instance-wise variational optimization. Recent semi-amorti…
Variational InferenceAmortized Interventional Forecasting for Multivariate CIR Processes
Mean-reverting dynamics are pervasive in finance, and the Cox--Ingersoll--Ross (CIR) process is a standard model for the time series they produce, from short rates to credit default swap (CDS) spreads. Yet CIR models cap…
Gaussian Process Modeling of Approximate Inference Errors for Variational Autoencoders
Variational autoencoder (VAE) is a very successful generative model whose key element is the so called amortized inference network, which can perform test time inference using a single feed forward pass. Unfortunatel…
Gaussian ProcessesReducing the Amortization Gap in Variational Autoencoders: A Bayesian Random Function Approach
Variational autoencoder (VAE) is a very successful generative model whose key element is the so called amortized inference network, which can perform test time inference using a single feed forward pass. Unfortunately, t…
Gaussian Processes