paper-with-me

홈 › Papers

Likelihood-based generalization of Markov parameter estimation and multiple shooting objectives in system identification

2022-12-20 · Nicholas Galioto, Alex Arkady Gorodetsky

This paper considers the problem of system identification (ID) of linear and nonlinear non-autonomous systems from noisy and sparse data. We propose and analyze an objective function derived from a Bayesian formulation for learning a hidden Markov model with stochastic dynamics. We then analyze this objective function in the context of several state-of-the-art approaches for both linear and nonlinear system ID. In the former, we analyze least squares approaches for Markov parameter estimation, and in the latter, we analyze the multiple shooting approach. We demonstrate the limitations of the optimization problems posed by these existing methods by showing that they can be seen as special cases of the proposed optimization objective under certain simplifying assumptions: conditional independence of data and zero model error. Furthermore, we observe that our proposed approach has improved smoothness and inherent regularization that make it well-suited for system ID and provide mathematical explanations for these characteristics' origins. Finally, numerical simulations demonstrate a mean squared error over 8.7 times lower compared to multiple shooting when data are noisy and/or sparse. Moreover, the proposed approach can identify accurate and generalizable models even when there are more parameters than data or when the underlying system exhibits chaotic behavior.

📄 PDF Abstract BibTeX arXiv:2212.13902

Code (1)

ngalioto/bayesid 공식 구현

Tasks

parameter estimation

Similar Papers 제목 키워드 기반

An Efficient Pseudo-likelihood Method for Sparse Binary Pairwise Markov Network Estimation

2017-02-27 · Sinong Geng, Zhaobin Kuang, David Page

The pseudo-likelihood method is one of the most popular algorithms for learning sparse binary pairwise Markov networks. In this paper, we formulate the $L_1$ regularized pseudo-likelihood problem as a sparse multiple log…

regression

Understanding Domain-Size Generalization in Markov Logic Networks

2024-03-23 · Florian Chen, Felix Weitkämper, Sagar Malhotra

We study the generalization behavior of Markov Logic Networks (MLNs) across relational structures of different sizes. Multiple works have noticed that MLNs learned on a given domain generalize poorly across domains of di…

Review on Parameter Estimation in HMRF

2017-11-20 · Namjoon Suh

This is a technical report which explores the estimation methodologies on hyper-parameters in Markov Random Field and Gaussian Hidden Markov Random Field. In first section, we briefly investigate a theoretical framework …

parameter estimation

Composite Likelihood Estimation for Restricted Boltzmann machines

2014-06-24 · Muneki Yasuda, Shun Kataoka, Yuji Waizumi, Kazuyuki Tanaka

Learning the parameters of graphical models using the maximum likelihood estimation is generally hard which requires an approximation. Maximum composite likelihood estimations are statistical approximations of the maximu…

Deep learning-based estimation of time-dependent parameters in Markov models with application to nonlinear regression and SDEs

2023-12-13 · Andrzej Kałuża, Paweł M. Morkisz, Bartłomiej Mulewicz, Paweł Przybyłowicz 외

We present a novel deep learning method for estimating time-dependent parameters in Markov processes through discrete sampling. Departing from conventional machine learning, our approach reframes parameter approximation …

parameter estimationregression