paper-with-me

홈 › Papers

A Bayesian Gaussian Process-Based Latent Discriminative Generative Decoder (LDGD) Model for High-Dimensional Data

2024-01-29 · Navid Ziaei, Behzad Nazari, Uri T. Eden, Alik Widge, Ali Yousefi

Extracting meaningful information from high-dimensional data poses a formidable modeling challenge, particularly when the data is obscured by noise or represented through different modalities. This research proposes a novel non-parametric modeling approach, leveraging the Gaussian process (GP), to characterize high-dimensional data by mapping it to a latent low-dimensional manifold. This model, named the latent discriminative generative decoder (LDGD), employs both the data and associated labels in the manifold discovery process. We derive a Bayesian solution to infer the latent variables, allowing LDGD to effectively capture inherent stochasticity in the data. We demonstrate applications of LDGD on both synthetic and benchmark datasets. Not only does LDGD infer the manifold accurately, but its accuracy in predicting data points' labels surpasses state-of-the-art approaches. In the development of LDGD, we have incorporated inducing points to reduce the computational complexity of Gaussian processes for large datasets, enabling batch training for enhanced efficient processing and scalability. Additionally, we show that LDGD can robustly infer manifold and precisely predict labels for scenarios in that data size is limited, demonstrating its capability to efficiently characterize high-dimensional data with limited samples. These collective attributes highlight the importance of developing non-parametric modeling approaches to analyze high-dimensional data.

📄 PDF Abstract BibTeX arXiv:2401.16497

Code (1)

navid-ziaei/ldgd 공식 구현 pytorch

Tasks

DecoderGaussian Processes

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Accuracy of Latent-Variable Estimation in Bayesian Semi-Supervised Learning

2013-08-09 · Keisuke Yamazaki

Hierarchical probabilistic models, such as Gaussian mixture models, are widely used for unsupervised learning tasks. These models consist of observable and latent variables, which represent the observable data and the un…

Fully Bayesian Autoencoders with Latent Sparse Gaussian Processes

2023-02-09 · Ba-Hien Tran, Babak Shahbaba, Stephan Mandt, Maurizio Filippone

Autoencoders and their variants are among the most widely used models in representation learning and generative modeling. However, autoencoder-based models usually assume that the learned representations are i.i.d. and f…

Gaussian ProcessesRepresentation Learning

Multi-Conditional Latent Variable Model for Joint Facial Action Unit Detection

2015-12-01 · ICCV 2015 12 · Stefanos Eleftheriadis, Ognjen Rudovic, Maja Pantic

We propose a novel multi-conditional latent variable model for simultaneous facial feature fusion and detection of facial action units. In our approach we exploit the structure-discovery capabilities of generative models…

Action Unit DetectionFacial Action Unit DetectionGaussian Processes

Structured Bayesian Gaussian process latent variable model: applications to data-driven dimensionality reduction and high-dimensional inversion

2018-07-11 · Steven Atkinson, Nicholas Zabaras

We introduce a methodology for nonlinear inverse problems using a variational Bayesian approach where the unknown quantity is a spatial field. A structured Bayesian Gaussian process latent variable model is used both to …

Dimensionality Reduction

DP-GP-LVM: A Bayesian Non-Parametric Model for Learning Multivariate Dependency Structures

2018-07-12 · Andrew R. Lawrence, Carl Henrik Ek, Neill D. F. Campbell

We present a non-parametric Bayesian latent variable model capable of learning dependency structures across dimensions in a multivariate setting. Our approach is based on flexible Gaussian process priors for the generati…