Hyperboloid GPLVM for Discovering Continuous Hierarchies via Nonparametric Estimation
Dimensionality reduction (DR) offers a useful representation of complex high-dimensional data. Recent DR methods focus on hyperbolic geometry to derive a faithful low-dimensional representation of hierarchical data. However, existing methods are based on neighbor embedding, frequently ruining the continual relation of the hierarchies. This paper presents hyperboloid Gaussian process (GP) latent variable models (hGP-LVMs) to embed high-dimensional hierarchical data with implicit continuity via nonparametric estimation. We adopt generative modeling using the GP, which brings effective hierarchical embedding and executes ill-posed hyperparameter tuning. This paper presents three variants that employ original point, sparse point, and Bayesian estimations. We establish their learning algorithms by incorporating the Riemannian optimization and active approximation scheme of GP-LVM. For Bayesian inference, we further introduce the reparameterization trick to realize Bayesian latent variable learning. In the last part of this paper, we apply hGP-LVMs to several datasets and show their ability to represent high-dimensional hierarchies in low-dimensional spaces.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian InferenceDimensionality ReductionRiemannian optimizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Tree-Structured Topic Modeling with Nonparametric Neural Variational Inference
Topic modeling has been widely used for discovering the latent semantic structure of documents, but most existing methods learn topics with a flat structure. Although probabilistic models can generate topic hierarchies b…
Variational InferenceHarmonized Multimodal Learning with Gaussian Process Latent Variable Models
Multimodal learning aims to discover the relationship between multiple modalities. It has become an important research topic due to extensive multimodal applications such as cross-modal retrieval. This paper attempts to …
Cross-Modal RetrievalRetrievalManifold GPLVMs for discovering non-Euclidean latent structure in neural data
A common problem in neuroscience is to elucidate the collective neural representations of behaviorally important variables such as head direction, spatial location, upcoming movements, or mental spatial transformations. …
Variational InferenceBreaking the Euclidean Barrier: Hyperboloid-Based Biological Sequence Analysis
Genomic sequence analysis plays a crucial role in various scientific and medical domains. Traditional machine-learning approaches often struggle to capture the complex relationships and hierarchical structures of sequenc…
Scalable Amortized GPLVMs for Single Cell Transcriptomics Data
Dimensionality reduction is crucial for analyzing large-scale single-cell RNA-seq data. Gaussian Process Latent Variable Models (GPLVMs) offer an interpretable dimensionality reduction method, but current scalable models…
ClusteringDimensionality ReductionVariational Inference