paper-with-me

Papers

Sequential Randomized Matrix Factorization for Gaussian Processes: Efficient Predictions and Hyper-parameter Optimization

2017-11-19 · Shaunak D. Bopardikar, George S. Eskander Ekladious

This paper presents a sequential randomized lowrank matrix factorization approach for incrementally predicting values of an unknown function at test points using the Gaussian Processes framework. It is well-known that in the Gaussian processes framework, the computational bottlenecks are the inversion of the (regularized) kernel matrix and the computation of the hyper-parameters defining the kernel. The main contributions of this paper are two-fold. First, we formalize an approach to compute the inverse of the kernel matrix using randomized matrix factorization algorithms in a streaming scenario, i.e., data is generated incrementally over time. The metrics of accuracy and computational efficiency of the proposed method are compared against a batch approach based on use of randomized matrix factorization and an existing streaming approach based on approximating the Gaussian process by a finite set of basis vectors. Second, we extend the sequential factorization approach to a class of kernel functions for which the hyperparameters can be efficiently optimized. All results are demonstrated on two publicly available datasets.

📄 PDF Abstract BibTeX arXiv:1711.06989

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyGaussian Processes

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Randomized Nonnegative Matrix Factorization

2017-11-06 · N. Benjamin Erichson, Ariana Mendible, Sophie Wihlborn, J. Nathan Kutz

Nonnegative matrix factorization (NMF) is a powerful tool for data mining. However, the emergence of `big data' has severely challenged our ability to compute this fundamental decomposition using deterministic algorithms…

Trajectory Space Factorization for Deep Video-Based 3D Human Pose Estimation

2019-08-22 · Jiahao Lin, Gim Hee Lee

Existing deep learning approaches on 3d human pose estimation for videos are either based on Recurrent or Convolutional Neural Networks (RNNs or CNNs). However, RNN-based frameworks can only tackle sequences with limited…

3D Human Pose Estimation3D Pose EstimationMonocular 3D Human Pose EstimationPose Estimation+1

Probabilistic sequential matrix factorization

2019-10-09 · Ömer Deniz Akyildiz, Gerrit J. J. van den Burg, Theodoros Damoulas, Mark F. J. Steel

We introduce the probabilistic sequential matrix factorization (PSMF) method for factorizing time-varying and non-stationary datasets consisting of high-dimensional time-series. In particular, we consider nonlinear Gauss…

ImputationMultivariate Time Series ForecastingMultivariate Time Series ImputationState Space Models+3

Divide-and-Conquer Matrix Factorization

2011-12-01 · NeurIPS 2011 12 · Lester W. Mackey, Michael. I. Jordan, Ameet Talwalkar

This work introduces Divide-Factor-Combine (DFC), a parallel divide-and-conquer framework for noisy matrix factorization. DFC divides a large-scale matrix factorization task into smaller subproblems, solves each subprob…

Collaborative Filtering

Variance Reduction for Matrix Computations with Applications to Gaussian Processes

2021-06-28 · Anant Mathur, Sarat Moka, Zdravko Botev

In addition to recent developments in computing speed and memory, methodological advances have contributed to significant gains in the performance of stochastic simulation. In this paper, we focus on variance reduction f…

Gaussian Processes