Principal component analysis for Gaussian process posteriors

2021-07-15 · Hideaki Ishibashi, Shotaro Akaho

This paper proposes an extension of principal component analysis for Gaussian process (GP) posteriors, denoted by GP-PCA. Since GP-PCA estimates a low-dimensional space of GP posteriors, it can be used for meta-learning, which is a framework for improving the performance of target tasks by estimating a structure of a set of tasks. The issue is how to define a structure of a set of GPs with an infinite-dimensional parameter, such as coordinate system and a divergence. In this study, we reduce the infiniteness of GP to the finite-dimensional case under the information geometrical framework by considering a space of GP posteriors that have the same prior. In addition, we propose an approximation method of GP-PCA based on variational inference and demonstrate the effectiveness of GP-PCA as meta-learning through experiments.

📄 PDF Abstract BibTeX arXiv:2107.07115

Code (0)

등록된 구현이 없습니다.

Tasks

Meta-LearningVariational Inference

Methods 이 논문이 사용한 방법론

Variational Inference 설명 없음

GPS Greedy Policy Search (GPS) is a simple algorithm that learns a policy for test-time data augmentation based on the predictive performance on a validation set. GPS starts with…

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Sequential Gibbs Posteriors with Applications to Principal Component Analysis

2023-10-19 · Steven Winter, Omar Melikechi, David B. Dunson

Gibbs posteriors are proportional to a prior distribution multiplied by an exponentiated loss function, with a key tuning parameter weighting information in the loss relative to the prior and providing a control of poste…

Bayesian Inference Uncertainty Quantification

Linear and Quadratic Discriminant Analysis: Tutorial

2019-06-01 · Benyamin Ghojogh, Mark Crowley

This tutorial explains Linear Discriminant Analysis (LDA) and Quadratic Discriminant Analysis (QDA) as two fundamental classification methods in statistical and probabilistic learning. We start with the optimization of d…

Dimensionality Reduction General Classification Metric Learning regression

Principal Basis Analysis in Sparse Representation

2015-11-25 · Hong Sun, Cheng-Wei Sang, Chen-Guang Liu

This article introduces a new signal analysis method, which can be interpreted as a principal component analysis in sparse decomposition of the signal. The method, called principal basis analysis, is based on a novel cri…

Denoising Image Denoising

Near-Optimal Stochastic Approximation for Online Principal Component Estimation

2016-03-16 · Chris Junchi Li, Mengdi Wang, Han Liu, Tong Zhang

Principal component analysis (PCA) has been a prominent tool for high-dimensional data analysis. Online algorithms that estimate the principal component by processing streaming data are of tremendous practical and theore…

Robust Principal Component Analysis Based On Maximum Correntropy Power Iterations

2019-10-24 · Jean P. Chereau, Bruno Scalzo Dees, Danilo P. Mandic

Principal component analysis (PCA) is recognised as a quintessential data analysis technique when it comes to describing linear relationships between the features of a dataset. However, the well-known sensitivity of PCA …