paper-with-me

Papers

On Disentanglement in Gaussian Process Variational Autoencoders

2021-02-10 · pproximateinference AABI Symposium 2022 2 · Simon Bing, Vincent Fortuin, Gunnar Rätsch

Complex multivariate time series arise in many fields, ranging from computer vision to robotics or medicine. Often we are interested in the independent underlying factors that give rise to the high-dimensional data we are observing. While many models have been introduced to learn such disentangled representations, only few attempt to explicitly exploit the structure of sequential data. We investigate the disentanglement properties of Gaussian process variational autoencoders, a class of models recently introduced that have been successful in different tasks on time series data. Our model exploits the temporal structure of the data by modeling each latent channel with a GP prior and employing a structured variational distribution that can capture dependencies in time. We demonstrate the competitiveness of our approach against state-of-the-art unsupervised and weakly-supervised disentanglement methods on a benchmark task. Moreover, we provide evidence that we can learn meaningful disentangled representations on real-world medical time series data.

📄 PDF Abstract BibTeX arXiv:2102.05507

Code (0)

등록된 구현이 없습니다.

Tasks

DisentanglementTime SeriesTime Series Analysis

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Uniform Transformation: Refining Latent Representation in Variational Autoencoders

2024-07-02 · Ye Shi, C. S. George Lee

Irregular distribution in latent space causes posterior collapse, misalignment between posterior and prior, and ill-sampling problem in Variational Autoencoders (VAEs). In this paper, we introduce a novel adaptable three…

Density EstimationDisentanglementRepresentation Learning

Quantifying the Effects of Enforcing Disentanglement on Variational Autoencoders

2017-11-24 · Momchil Peychev, Petar Veličković, Pietro Liò

The notion of disentangled autoencoders was proposed as an extension to the variational autoencoder by introducing a disentanglement parameter $\beta$, controlling the learning pressure put on the possible underlying lat…

Disentanglement

Disentanglement Learning for Variational Autoencoders Applied to Audio-Visual Speech Enhancement

2021-05-19 · Guillaume Carbajal, Julius Richter, Timo Gerkmann

Recently, the standard variational autoencoder has been successfully used to learn a probabilistic prior over speech signals, which is then used to perform speech enhancement. Variational autoencoders have then been cond…

AttributeDecoderDisentanglementSpeech Enhancement

Factorized Gaussian Process Variational Autoencoders

2020-11-14 · pproximateinference AABI Symposium 2021 1 · Metod Jazbec, Michael Pearce, Vincent Fortuin

Variational autoencoders often assume isotropic Gaussian priors and mean-field posteriors, hence do not exploit structure in scenarios where we may expect similarity or consistency across latent variables. Gaussian proce…

The advantage of using Student's t-priors in variational autoencoders

2019-09-25 · Najmeh Abiri, Mattias Ohlsson

Is it optimal to use the standard Gaussian prior in variational autoencoders? With Gaussian distributions, which are not weakly informative priors, variational autoencoders struggle to reconstruct the actual data. We pro…