paper-with-me

홈 › Papers

Inferring the parameters of a Markov process from snapshots of the steady state

2017-07-13 · Simon Lee Dettmer, Johannes Berg

We seek to infer the parameters of an ergodic Markov process from samples taken independently from the steady state. Our focus is on non-equilibrium processes, where the steady state is not described by the Boltzmann measure, but is generally unknown and hard to compute, which prevents the application of established equilibrium inference methods. We propose a quantity we call propagator likelihood, which takes on the role of the likelihood in equilibrium processes. This propagator likelihood is based on fictitious transitions between those configurations of the system which occur in the samples. The propagator likelihood can be derived by minimising the relative entropy between the empirical distribution and a distribution generated by propagating the empirical distribution forward in time. Maximising the propagator likelihood leads to an efficient reconstruction of the parameters of the underlying model in different systems, both with discrete configurations and with continuous configurations. We apply the method to non-equilibrium models from statistical physics and theoretical biology, including the asymmetric simple exclusion process (ASEP), the kinetic Ising model, and replicator dynamics.

📄 PDF Abstract BibTeX arXiv:1707.04114

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Sensitivity of steady states in networks with application to Markov chains and chemical reaction networks

2022-09-08 · Robin Chemnitz

We consider steady states of dynamics that have an underlying network structure. We study how a steady state responds to small perturbations in the network parameters and how this sensitivity is connected to the network …

Sensitivity

A finite state projection method for steady-state sensitivity analysis of stochastic reaction networks

2018-12-11

Consider the standard stochastic reaction network model where the dynamics is given by a continuous-time Markov chain over a discrete lattice. For such models, estimation of parameter sensitivities is an important proble…

Sensitivity

Inferring gene regulation dynamics from static snapshots of gene expression variability

2021-09-01 · Euan Joly-Smith, Zitong Jerry Wang, Andreas Hilfinger

Inferring functional relationships within complex networks from static snapshots of a subset of variables is a ubiquitous problem in science. For example, a key challenge of systems biology is to translate cellular heter…

Inferring Network Evolutionary History via Structure-State Coupled Learning

2026-01-05 · En Xu, Shihe Zhou, Huandong Wang, Jingtao Ding 외 arxiv

Inferring a network's evolutionary history from a single final snapshot with limited temporal annotations is fundamental yet challenging. Existing approaches predominantly rely on topology alone, which often provides ins…

Controller Synthesis for Omega-Regular and Steady-State Specifications

2021-06-05 · Alvaro Velasquez, Ismail Alkhouri, Andre Beckus, Ashutosh Trivedi 외

Given a Markov decision process (MDP) and a linear-time ($\omega$-regular or LTL) specification, the controller synthesis problem aims to compute the optimal policy that satisfies the specification. More recently, proble…