paper-with-me

Papers

Probabilistic Neural Transfer Function Estimation with Bayesian System Identification

2023-08-11 · Nan Wu, Isabel Valera, Fabian Sinz, Alexander Ecker, Thomas Euler, Yongrong Qiu

Neural population responses in sensory systems are driven by external physical stimuli. This stimulus-response relationship is typically characterized by receptive fields, which have been estimated by neural system identification approaches. Such models usually requires a large amount of training data, yet, the recording time for animal experiments is limited, giving rise to epistemic uncertainty for the learned neural transfer functions. While deep neural network models have demonstrated excellent power on neural prediction, they usually do not provide the uncertainty of the resulting neural representations and derived statistics, such as the stimuli driving neurons optimally, from in silico experiments. Here, we present a Bayesian system identification approach to predict neural responses to visual stimuli, and explore whether explicitly modeling network weight variability can be beneficial for identifying neural response properties. To this end, we use variational inference to estimate the posterior distribution of each model weight given the training data. Tests with different neural datasets demonstrate that this method can achieve higher or comparable performance on neural prediction, with a much higher data efficiency compared to Monte Carlo dropout methods and traditional models using point estimates of the model parameters. Furthermore, our approach enables to identify response properties with credible intervals and perform statistical test for the learned neural features, which avoid the idiosyncrasy of a single model. Finally, in silico experiments show that our model generates stimuli driving neuronal activity significantly better than traditional models, particularly in the limited-data regime.

📄 PDF Abstract BibTeX arXiv:2308.05990

Code (0)

등록된 구현이 없습니다.

Tasks

Variational Inference

Methods 이 논문이 사용한 방법론

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Monte Carlo Dropout 설명 없음
Variational Inference 설명 없음

Similar Papers 제목 키워드 기반

Bayesian Spectral Deconvolution Based on Poisson Distribution: Bayesian Measurement and Virtual Measurement Analytics (VMA)

2018-12-11 · Kenji Nagata, Yoh-ichi Mototake, Rei Muraoka, Takehiko Sasaki 외

In this paper, we propose a new method of Bayesian measurement for spectral deconvolution, which regresses spectral data into the sum of unimodal basis function such as Gaussian or Lorentzian functions. Bayesian measurem…

Topology Change Aware Data-Driven Probabilistic Distribution State Estimation Based on Gaussian Process

2022-09-05 · IEEE Transactions on Smart Grid 2022 9 · Di Cao, Member, Junbo Zhao, Weihao Hu 외

Abstract—This paper addresses the distribution system state estimation (DSSE) with unknown topology change. A specific kernel that can transfer across tasks is adopted to find relevant patterns from samples under d…

Bayesian InferenceState EstimationTransfer Learning

Hybrid Bayesian Neural Networks with Functional Probabilistic Layers

2021-07-14 · Daniel T. Chang

Bayesian neural networks provide a direct and natural way to extend standard deep neural networks to support probabilistic deep learning through the use of probabilistic layers that, traditionally, encode weight (and bia…

Bayesian InferenceGaussian ProcessesProbabilistic Deep LearningVariational Inference

A Multi-model Combination Approach for Probabilistic Wind Power Forecasting

2017-02-13 · You Lin, Ming Yang, Can Wan, Jianhui Wang 외

Short-term probabilistic wind power forecasting can provide critical quantified uncertainty information of wind generation for power system operation and control. As the complicated characteristics of wind power predicti…

Density Estimation

Density Ratio Estimation-based Bayesian Optimization with Semi-Supervised Learning

2023-05-24 · Jungtaek Kim

Bayesian optimization has attracted huge attention from diverse research areas in science and engineering, since it is capable of efficiently finding a global optimum of an expensive-to-evaluate black-box function. In ge…

Bayesian OptimizationDensity Ratio EstimationGaussian Processesregression