Fast and Reliable Parameter Estimation from Nonlinear Observations
In this paper we study the problem of recovering a structured but unknown parameter ${\bf{\theta}}^*$ from $n$ nonlinear observations of the form $y_i=f(\langle {\bf{x}}_i,{\bf{\theta}}^*\rangle)$ for $i=1,2,\ldots,n$. We develop a framework for characterizing time-data tradeoffs for a variety of parameter estimation algorithms when the nonlinear function $f$ is unknown. This framework includes many popular heuristics such as projected/proximal gradient descent and stochastic schemes. For example, we show that a projected gradient descent scheme converges at a linear rate to a reliable solution with a near minimal number of samples. We provide a sharp characterization of the convergence rate of such algorithms as a function of sample size, amount of a-prior knowledge available about the parameter and a measure of the nonlinearity of the function $f$. These results provide a precise understanding of the various tradeoffs involved between statistical and computational resources as well as a-prior side information available for such nonlinear parameter estimation problems.
Code (0)
등록된 구현이 없습니다.
Tasks
parameter estimationSimilar Papers 제목 키워드 기반
Physics-Informed Regression: Parameter Estimation in Parameter-Linear Nonlinear Dynamic Models
We present a new efficient hybrid parameter estimation method based on the idea, that if nonlinear dynamic models are stated in terms of a system of equations that is linear in terms of the parameters, then regularized o…
Nonlinear Statistical Data Assimilation for HVC$_{\text{RA}}$ Neurons in the Avian Song System
With the goal of building a model of the HVC nucleus in the avian song system, we discuss in detail a model of HVC$_{\text{RA}}$ projection neurons comprised of a somatic compartment with fast Na$^+$ and K$^+$ currents a…
BlockingParameter and coupling estimation in small groups of Izhikevich neurons
Nowadays, experimental techniques allow scientists to have access to large amounts of data. In order to obtain reliable information from the complex systems which produce these data, appropriate analysis tools are needed…
Robust Parameter and State Estimation in Multiscale Neuronal Systems Using Physics-Informed Neural Networks
Inferring biophysical parameters and hidden state variables from partial and noisy observations is a fundamental challenge in computational neuroscience. This problem is particularly difficult for fast - slow spiking and…
Data Denoising and Derivative Estimation for Data-Driven Modeling of Nonlinear Dynamical Systems
Data-driven modeling of nonlinear dynamical systems is often hampered by measurement noise. We propose a denoising framework, called Runge-Kutta and Total Variation Based Implicit Neural Representation (RKTV-INR), that r…