paper-with-me

홈 › Papers

Neighbour-Driven Gaussian Process Variational Autoencoders for Scalable Structured Latent Modelling

2025-05-22 · Xinxing Shi, Xiaoyu Jiang, Mauricio A. Álvarez

Gaussian Process (GP) Variational Autoencoders (VAEs) extend standard VAEs by replacing the fully factorised Gaussian prior with a GP prior, thereby capturing richer correlations among latent variables. However, performing exact GP inference in large-scale GPVAEs is computationally prohibitive, often forcing existing approaches to rely on restrictive kernel assumptions or large sets of inducing points. In this work, we propose a neighbour-driven approximation strategy that exploits local adjacencies in the latent space to achieve scalable GPVAE inference. By confining computations to the nearest neighbours of each data point, our method preserves essential latent dependencies, allowing more flexible kernel choices and mitigating the need for numerous inducing points. Through extensive experiments on tasks including representation learning, data imputation, and conditional generation, we demonstrate that our approach outperforms other GPVAE variants in both predictive performance and computational efficiency.

📄 PDF Abstract BibTeX arXiv:2505.16481

Code (1)

shixinxing/nngpvae-official 공식 구현 pytorch

Tasks

Computational EfficiencyImputationRepresentation Learning

Similar Papers 제목 키워드 기반

Factorized Gaussian Process Variational Autoencoders

2020-11-14 · pproximateinference AABI Symposium 2021 1 · Metod Jazbec, Michael Pearce, Vincent Fortuin

Variational autoencoders often assume isotropic Gaussian priors and mean-field posteriors, hence do not exploit structure in scenarios where we may expect similarity or consistency across latent variables. Gaussian proce…

The advantage of using Student's t-priors in variational autoencoders

2019-09-25 · Najmeh Abiri, Mattias Ohlsson

Is it optimal to use the standard Gaussian prior in variational autoencoders? With Gaussian distributions, which are not weakly informative priors, variational autoencoders struggle to reconstruct the actual data. We pro…

Dynamic Variational Autoencoders for Visual Process Modeling

2018-03-20 · Alexander Sagel, Hao Shen

This work studies the problem of modeling visual processes by leveraging deep generative architectures for learning linear, Gaussian representations from observed sequences. We propose a joint learning framework, combini…

Scalable Gaussian Process Variational Autoencoders

2020-10-26 · Metod Jazbec, Matthew Ashman, Vincent Fortuin, Michael Pearce 외

Conventional variational autoencoders fail in modeling correlations between data points due to their use of factorized priors. Amortized Gaussian process inference through GP-VAEs has led to significant improvements in t…

Improving Novelty Detection using the Reconstructions of Nearest Neighbours

2021-11-11 · Michael Mesarcik, Elena Ranguelova, Albert-Jan Boonstra, Rob V. van Nieuwpoort

We show that using nearest neighbours in the latent space of autoencoders (AE) significantly improves performance of semi-supervised novelty detection in both single and multi-class contexts. Autoencoding methods detect …

Anomaly DetectionData AugmentationNovelty Detection