paper-with-me

Papers

Learning Conditional Variational Autoencoders with Missing Covariates

2022-03-02 · Siddharth Ramchandran, Gleb Tikhonov, Otto Lönnroth, Pekka Tiikkainen, Harri Lähdesmäki

Conditional variational autoencoders (CVAEs) are versatile deep generative models that extend the standard VAE framework by conditioning the generative model with auxiliary covariates. The original CVAE model assumes that the data samples are independent, whereas more recent conditional VAE models, such as the Gaussian process (GP) prior VAEs, can account for complex correlation structures across all data samples. While several methods have been proposed to learn standard VAEs from partially observed datasets, these methods fall short for conditional VAEs. In this work, we propose a method to learn conditional VAEs from datasets in which auxiliary covariates can contain missing values as well. The proposed method augments the conditional VAEs with a prior distribution for the missing covariates and estimates their posterior using amortised variational inference. At training time, our method marginalises the uncertainty associated with the missing covariates while simultaneously maximising the evidence lower bound. We develop computationally efficient methods to learn CVAEs and GP prior VAEs that are compatible with mini-batching. Our experiments on simulated datasets as well as on a clinical trial study show that the proposed method outperforms previous methods in learning conditional VAEs from non-temporal, temporal, and longitudinal datasets.

📄 PDF Abstract BibTeX arXiv:2203.01218

Code (0)

등록된 구현이 없습니다.

Tasks

Missing ValuesVariational Inference

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…
cVAE 설명 없음

Similar Papers 제목 키워드 기반

Conditional Sampling of Variational Autoencoders via Iterated Approximate Ancestral Sampling

2023-08-17 · Vaidotas Simkus, Michael U. Gutmann

Conditional sampling of variational autoencoders (VAEs) is needed in various applications, such as missing data imputation, but is computationally intractable. A principled choice for asymptotically exact conditional sam…

Imputation

Latent mixed-effect models for high-dimensional longitudinal data

2024-09-17 · Priscilla Ong, Manuel Haußmann, Otto Lönnroth, Harri Lähdesmäki

Modelling longitudinal data is an important yet challenging task. These datasets can be high-dimensional, contain non-linear effects and time-varying covariates. Gaussian process (GP) prior-based variational autoencoders…

Time SeriesVariational Inference

Misguided Use of Observed Covariates to Impute Missing Covariates in Conditional Prediction: A Shrinkage Problem

2021-02-22 · Charles F Manski, Michael Gmeiner, Anat Tamburc

Researchers regularly perform conditional prediction using imputed values of missing data. However, applications of imputation often lack a firm foundation in statistical theory. This paper originated when we were unable…

Imputation

MissDeepCausal: Causal Inference from Incomplete Data Using Deep Latent Variable Models

2020-02-25 · Imke Mayer, Julie Josse, Félix Raimundo, Jean-Philippe Vert

Inferring causal effects of a treatment, intervention or policy from observational data is central to many applications. However, state-of-the-art methods for causal inference seldom consider the possibility that covaria…

Causal InferenceImputationMissing Values

Correlating Variational Autoencoders Natively For Multi-View Imputation

2024-11-05 · Ella S. C. Orme, Marina Evangelou, Ulrich Paquet

Multi-view data from the same source often exhibit correlation. This is mirrored in correlation between the latent spaces of separate variational autoencoders (VAEs) trained on each data-view. A multi-view VAE approach i…

Imputation