paper-with-me

Papers

Scalable Bayesian GPFA with automatic relevance determination and discrete noise models

2021-12-01 · NeurIPS 2021 12 · Kristopher Jensen, Ta-Chu Kao, Jasmine Stone, Guillaume Hennequin

Latent variable models are ubiquitous in the exploratory analysis of neural population recordings, where they allow researchers to summarize the activity of large populations of neurons in lower dimensional ‘latent’ spaces. Existing methods can generally be categorized into (i) Bayesian methods that facilitate flexible incorporation of prior knowledge and uncertainty estimation, but which typically do not scale to large datasets; and (ii) highly parameterized methods without explicit priors that scale better but often struggle in the low-data regime. Here, we bridge this gap by developing a fully Bayesian yet scalable version of Gaussian process factor analysis (bGPFA), which models neural data as arising from a set of inferred latent processes with a prior that encourages smoothness over time. Additionally, bGPFA uses automatic relevance determination to infer the dimensionality of neural activity directly from the training data during optimization. To enable the analysis of continuous recordings without trial structure, we introduce a novel variational inference strategy that scales near-linearly in time and also allows for non-Gaussian noise models appropriate for electrophysiological recordings. We apply bGPFA to continuous recordings spanning 30 minutes with over 14 million data points from primate motor and somatosensory cortices during a self-paced reaching task. We show that neural activity progresses from an initial state at target onset to a reach- specific preparatory state well before movement onset. The distance between these initial and preparatory latent states is predictive of reaction times across reaches, suggesting that such preparatory dynamics have behavioral relevance despite the lack of externally imposed delay periods. Additionally, bGPFA discovers latent processes that evolve over slow timescales on the order of several seconds and contain complementary information about reaction time. These timescales are longer than those revealed by methods which focus on individual movement epochs and may reflect fluctuations in e.g. task engagement.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Variational Inference

Methods 이 논문이 사용한 방법론

Variational Inference 설명 없음
Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

An Automatic Relevance Determination Prior Bayesian Neural Network for Controlled Variable Selection

2020-01-06 · Rendani Mbuvha, Illyes Boulkaibet, Tshilidzi Marwala

We present an Automatic Relevance Determination prior Bayesian Neural Network(BNN-ARD) weight l2-norm measure as a feature importance statistic for the model-x knockoff filter. We show on both simulated data and the Norw…

Feature ImportanceVariable Selection

Comparative Study of Inference Methods for Interpolative Decomposition

2022-06-29 · Jun Lu

In this paper, we propose a probabilistic model with automatic relevance determination (ARD) for learning interpolative decomposition (ID), which is commonly used for low-rank approximation, feature selection, and identi…

Bayesian Inferencefeature selection

Automatic Relevance Determination For Deep Generative Models

2015-05-28 · Theofanis Karaletsos, Gunnar Rätsch

A recurring problem when building probabilistic latent variable models is regularization and model selection, for instance, the choice of the dimensionality of the latent space. In the context of belief networks with lat…

Model SelectionVariational Inference

Sparse Methods for Automatic Relevance Determination

2020-05-18 · Samuel H. Rudy, Themistoklis P. Sapsis

This work considers methods for imposing sparsity in Bayesian regression with applications in nonlinear system identification. We first review automatic relevance determination (ARD) and analytically demonstrate the need…

regression

Bayesian Automatic Relevance Determination for Utility Function Specification in Discrete Choice Models

2019-06-10 · Filipe Rodrigues, Nicola Ortelli, Michel Bierlaire, Francisco Pereira

Specifying utility functions is a key step towards applying the discrete choice framework for understanding the behaviour processes that govern user choices. However, identifying the utility function specifications that …

Bayesian InferenceDiscrete Choice ModelsVariational Inference