paper-with-me

Papers

Efficient non-conjugate Gaussian process factor models for spike count data using polynomial approximations

2019-06-07 · Stephen L. Keeley, David M. Zoltowski, Yiyi Yu, Jacob L. Yates, Spencer L. Smith, Jonathan W. Pillow

Gaussian Process Factor Analysis (GPFA) has been broadly applied to the problem of identifying smooth, low-dimensional temporal structure underlying large-scale neural recordings. However, spike trains are non-Gaussian, which motivates combining GPFA with discrete observation models for binned spike count data. The drawback to this approach is that GPFA priors are not conjugate to count model likelihoods, which makes inference challenging. Here we address this obstacle by introducing a fast, approximate inference method for non-conjugate GPFA models. Our approach uses orthogonal second-order polynomials to approximate the nonlinear terms in the non-conjugate log-likelihood, resulting in a method we refer to as \textit{polynomial approximate log-likelihood} (PAL) estimators. This approximation allows for accurate closed-form evaluation of marginal likelihoods and fast numerical optimization for parameters and hyperparameters. We derive PAL estimators for GPFA models with binomial, Poisson, and negative binomial observations and find the PAL estimation is highly accurate, and achieves faster convergence times compared to existing state-of-the-art inference methods. We also find that PAL hyperparameters can provide sensible initialization for black box variational inference (BBVI), which improves BBVI accuracy. We demonstrate that PAL estimators achieve fast and accurate extraction of latent structure from multi-neuron spike train data.

📄 PDF Abstract BibTeX arXiv:1906.03318

Code (0)

등록된 구현이 없습니다.

Tasks

Variational Inference

Similar Papers 제목 키워드 기반

Conditionally-Conjugate Gaussian Process Factor Analysis for Spike Count Data via Data Augmentation

2024-05-19 · Yididiya Y. Nadew, Xuhui Fan, Christopher J. Quinn

Gaussian process factor analysis (GPFA) is a latent variable modeling technique commonly used to identify smooth, low-dimensional latent trajectories underlying high-dimensional neural recordings. Specifically, researche…

Data AugmentationGaussian ProcessesNumerical Integration

Efficient non-conjugate Gaussian process factor models for spike countdata using polynomial approximations

2020-01-01 · ICML 2020 1 · Stephen Keeley, David Zoltowski, Jonathan Pillow, Spencer Smith 외

Gaussian Process Factor Analysis (GPFA) hasbeen broadly applied to the problem of identi-fying smooth, low-dimensional temporal struc-ture underlying large-scale neural recordings.However, spike trains are non-Gaussian, …

Variational Inference

How to use KL-divergence to construct conjugate priors, with well-defined non-informative limits, for the multivariate Gaussian

2021-09-15 · Niko Brümmer

The Wishart distribution is the standard conjugate prior for the precision of the multivariate Gaussian likelihood, when the mean is known -- while the normal-Wishart can be used when the mean is also unknown. It is howe…

Probabilistic Tensor Decomposition of Neural Population Spiking Activity

2021-12-01 · NeurIPS 2021 12 · Hugo Soulat, Sepiedeh Keshavarzi, Troy Margrie, Maneesh Sahani

The firing of neural populations is coordinated across cells, in time, and across experimentalconditions or repeated experimental trials; and so a full understanding of the computationalsignificance of neural responses m…

AnatomyTensor DecompositionVariational Inference

Tighter Bounds on the Log Marginal Likelihood of Gaussian Process Regression Using Conjugate Gradients

2021-02-16 · Artem Artemev, David R. Burt, Mark van der Wilk

We propose a lower bound on the log marginal likelihood of Gaussian process regression models that can be computed without matrix factorisation of the full kernel matrix. We show that approximate maximum likelihood learn…

Gaussian Processesregression