paper-with-me

Papers

Deep Amortized Variational Inference for Multivariate Time Series Imputation with Latent Gaussian Process Models

2019-10-16 · pproximateinference AABI Symposium 2019 12 · Vincent Fortuin, Dmitry Baranchuk, Gunnar Rätsch, Stephan Mandt

Multivariate time series with missing values are common in areas such as healthcare and finance, and have grown in number and complexity over the years. This raises the question whether deep learning methodologies can outperform classical data imputation methods in this domain. However, naive applications of deep learning fall short in giving reliable confidence estimates and lack interpretability. We propose a new deep sequential latent variable model for dimensionality reduction and data imputation. Our modeling assumption is simple and interpretable: the high dimensional time series has a lower-dimensional representation which evolves smoothly in time according to a Gaussian process. The non-linear dimensionality reduction in the presence of missing data is achieved using a VAE approach with a novel structured variational approximation. We demonstrate that our approach outperforms several classical and deep learning-based data imputation methods on high-dimensional data from the domains of computer vision and healthcare, while additionally improving the smoothness of the imputations and providing interpretable uncertainty estimates.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Deep LearningDimensionality ReductionImputationMissing ValuesMultivariate Time Series ImputationTime SeriesTime Series AnalysisVariational Inference

Similar Papers 제목 키워드 기반

Amortized Control of Continuous State Space Feynman-Kac Model for Irregular Time Series

2024-10-08 · Byoungwoo Park, Hyungi Lee, Juho Lee

Many real-world datasets, such as healthcare, climate, and economics, are often collected as irregular time series, which poses challenges for accurate modeling. In this paper, we propose the Amortized Control of continu…

Computational EfficiencyIrregular Time SeriesRepresentation LearningTime Series+1

Recursive Inference for Variational Autoencoders

2020-11-17 · NeurIPS 2020 12 · Minyoung Kim, Vladimir Pavlovic

Inference networks of traditional Variational Autoencoders (VAEs) are typically amortized, resulting in relatively inaccurate posterior approximation compared to instance-wise variational optimization. Recent semi-amorti…

Variational Inference

Amortized Interventional Forecasting for Multivariate CIR Processes

2026-08-04 · Andreas Sauter, Sumit Sourabh, Drona Kandhai, Erman Acar arxiv

Mean-reverting dynamics are pervasive in finance, and the Cox--Ingersoll--Ross (CIR) process is a standard model for the time series they produce, from short rates to credit default swap (CDS) spreads. Yet CIR models cap…

Gaussian Process Modeling of Approximate Inference Errors for Variational Autoencoders

2022-01-01 · CVPR 2022 1 · Minyoung Kim

Variational autoencoder (VAE) is a very successful generative model whose key element is the so called amortized inference network, which can perform test time inference using a single feed forward pass. Unfortunatel…

Gaussian Processes

Reducing the Amortization Gap in Variational Autoencoders: A Bayesian Random Function Approach

2021-02-05 · Minyoung Kim, Vladimir Pavlovic

Variational autoencoder (VAE) is a very successful generative model whose key element is the so called amortized inference network, which can perform test time inference using a single feed forward pass. Unfortunately, t…

Gaussian Processes