paper-with-me

Papers

Gradient estimators for parameter inference in discrete stochastic kinetic models

2026-04-02 · Ludwig Burger, Annalena Kofler, Lukas Heinrich, Ulrich Gerland arxiv

Stochastic kinetic models are ubiquitous in physics, yet inferring their parameters from experimental data remains challenging. For deterministic models, parameter inference often relies on gradients, which can be obtained efficiently through automatic differentiation (AD). However, AD cannot be applied directly to the Gillespie stochastic simulation algorithm (SSA), since sampling from a discrete set of reactions introduces non-differentiable operations. In this work, we adopt three gradient estimators from machine learning for the Gillespie SSA: the Gumbel-Softmax Straight-Through (GS-ST) estimator, the Score Function estimator, and the Alternative Path estimator. We use the estimators to evaluate gradients of steady-state and time-dependent observables, and compare their performance in representative biophysical systems with relaxation dynamics (bimolecular association) and oscillatory dynamics (repressilator). We find that the GS-ST estimator generally yields well-behaved gradient estimates, but exhibits diverging variance in challenging parameter regimes, which can cause parameter inference to fail. In these cases, other estimators provide more robust, lower variance gradients. Our results demonstrate that gradient-based parameter inference can be effectively combined with the Gillespie SSA, with different estimators offering complementary advantages.

📄 PDF Abstract BibTeX arXiv:2604.02121

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Improved Gradient Estimators for Stochastic Discrete Variables

2018-09-27 · Evgeny Andriyash, Arash Vahdat, Bill Macready

In many applications we seek to optimize an expectation with respect to a distribution over discrete variables. Estimating gradients of such objectives with respect to the distribution parameters is a challenging problem…

Variational Inference

Perturbative estimation of stochastic gradients

2019-03-31 · Luca Ambrogioni, Marcel A. J. van Gerven

In this paper we introduce a family of stochastic gradient estimation techniques based of the perturbative expansion around the mean of the sampling distribution. We characterize the bias and variance of the resulting Ta…

Variational Inference

Categorical Reparameterization with Denoising Diffusion models

2026-01-02 · Samson Gourevitch, Alain Durmus, Eric Moulines, Jimmy Olsson 외 arxiv

Learning models with categorical variables requires optimizing expectations over discrete distributions, a setting in which stochastic gradient-based optimization is challenging due to the non-differentiability of catego…

Stochastic Gradient MCMC for State Space Models

2018-10-22 · Christopher Aicher, Yi-An Ma, Nicholas J. Foti, Emily B. Fox

State space models (SSMs) are a flexible approach to modeling complex time series. However, inference in SSMs is often computationally prohibitive for long time series. Stochastic gradient MCMC (SGMCMC) is a popular meth…

Bayesian InferenceState Space ModelsTime SeriesTime Series Analysis

Asymptotic and finite-sample properties of estimators based on stochastic gradients

2014-08-13 · Panos Toulis, Edoardo M. Airoldi

Stochastic gradient descent procedures have gained popularity for parameter estimation from large data sets. However, their statistical properties are not well understood, in theory. And in practice, avoiding numerical i…

parameter estimation