paper-with-me

Papers

Inferring stochastic low-rank recurrent neural networks from neural data

2024-06-24 · Matthijs Pals, A Erdem Sağtekin, Felix Pei, Manuel Gloeckler, Jakob H Macke

A central aim in computational neuroscience is to relate the activity of large populations of neurons to an underlying dynamical system. Models of these neural dynamics should ideally be both interpretable and fit the observed data well. Low-rank recurrent neural networks (RNNs) exhibit such interpretability by having tractable dynamics. However, it is unclear how to best fit low-rank RNNs to data consisting of noisy observations of an underlying stochastic system. Here, we propose to fit stochastic low-rank RNNs with variational sequential Monte Carlo methods. We validate our method on several datasets consisting of both continuous and spiking neural data, where we obtain lower dimensional latent dynamics than current state of the art methods. Additionally, for low-rank models with piecewise linear nonlinearities, we show how to efficiently identify all fixed points in polynomial rather than exponential cost in the number of units, making analysis of the inferred dynamics tractable for large RNNs. Our method both elucidates the dynamical systems underlying experimental recordings and provides a generative model whose trajectories match observed variability.

📄 PDF Abstract BibTeX arXiv:2406.16749

Code (1)

mackelab/smc_rnns 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Economy Statistical Recurrent Units For Inferring Nonlinear Granger Causality

2019-11-22 · ICLR 2020 1 · Saurabh Khanna, Vincent Y. F. Tan

Granger causality is a widely-used criterion for analyzing interactions in large-scale networks. As most physical interactions are inherently nonlinear, we consider the problem of inferring the existence of pairwise Gran…

Time SeriesTime Series AnalysisTime Series Prediction

Riemannian Stochastic Gradient Descent for Tensor-Train Recurrent Neural Networks

2019-05-01 · ICLR 2019 5 · Jun Qi, Chin-Hui Lee, Javier Tejedor

The Tensor-Train factorization (TTF) is an efficient way to compress large weight matrices of fully-connected layers and recurrent layers in recurrent neural networks (RNNs). However, high Tensor-Train ranks for all the …

DecoderMachine TranslationTranslation

Deep Recurrent Modelling of Granger Causality with Latent Confounding

2022-02-23 · Zexuan Yin, Paolo Barucca

Inferring causal relationships in observational time series data is an important task when interventions cannot be performed. Granger causality is a popular framework to infer potential causal mechanisms between differen…

DecoderTime SeriesTime Series Analysis

A Deep Recurrent Survival Model for Unbiased Ranking

2020-04-30 · Jiarui Jin, Yuchen Fang, Wei-Nan Zhang, Kan Ren 외

Position bias is a critical problem in information retrieval when dealing with implicit yet biased user feedback data. Unbiased ranking methods typically rely on causality models and debias the user feedback through inve…

Information RetrievalmodelPositionRetrieval+1

State-space Decomposition Model for Video Prediction Considering Long-term Motion Trend

2024-04-17 · Fei Cui, Jiaojiao Fang, Xiaojiang Wu, Zelong Lai 외

Stochastic video prediction enables the consideration of uncertainty in future motion, thereby providing a better reflection of the dynamic nature of the environment. Stochastic video prediction methods based on image au…

motion predictionPredictionState Space ModelsVideo Prediction