Gaussian Experts Selection using Graphical Models
Local approximations are popular methods to scale Gaussian processes (GPs) to big data. Local approximations reduce time complexity by dividing the original dataset into subsets and training a local expert on each subset. Aggregating the experts' prediction is done assuming either conditional dependence or independence between the experts. Imposing the \emph{conditional independence assumption} (CI) between the experts renders the aggregation of different expert predictions time efficient at the cost of poor uncertainty quantification. On the other hand, modeling dependent experts can provide precise predictions and uncertainty quantification at the expense of impractically high computational costs. By eliminating weak experts via a theory-guided expert selection step, we substantially reduce the computational cost of aggregating dependent experts while ensuring calibrated uncertainty quantification. We leverage techniques from the literature on undirected graphical models, using sparse precision matrices that encode conditional dependencies between experts to select the most important experts. Moreov
Code (0)
등록된 구현이 없습니다.
Tasks
Gaussian ProcessesUncertainty QuantificationSimilar Papers 제목 키워드 기반
Efficient Neighborhood Selection for Gaussian Graphical Models
This paper addresses the problem of neighborhood selection for Gaussian graphical models. We present two heuristic algorithms: a forward-backward greedy algorithm for general Gaussian graphical models based on mutual inf…
Optimal statistical decision for Gaussian graphical model selection
Gaussian graphical model is a graphical representation of the dependence structure for a Gaussian random vector. It is recognized as a powerful tool in different applied fields such as bioinformatics, error-control codes…
Information RetrievalmodelModel SelectionRetrievalGraph Coding for Model Selection and Anomaly Detection in Gaussian Graphical Models
A classic application of description length is for model selection with the minimum description length (MDL) principle. The focus of this paper is to extend description length for data analysis beyond simple model select…
Anomaly DetectionModel SelectionAggregating Dependent Gaussian Experts in Local Approximation
Distributed Gaussian processes (DGPs) are prominent local approximation methods to scale Gaussian processes (GPs) to large datasets. Instead of a global estimation, they train local experts by dividing the training set i…
DiversityGaussian ProcessesGaussian Graphical Models as an Ensemble Method for Distributed Gaussian Processes
Distributed Gaussian process (DGP) is a popular approach to scale GP to big data which divides the training data into some subsets, performs local inference for each partition, and aggregates the results to acquire globa…
DiversityGaussian Processes