Stationary Density Estimation of Itô Diffusions Using Deep Learning
In this paper, we consider the density estimation problem associated with the stationary measure of ergodic It\^o diffusions from a discrete-time series that approximate the solutions of the stochastic differential equations. To take an advantage of the characterization of density function through the stationary solution of a parabolic-type Fokker-Planck PDE, we proceed as follows. First, we employ deep neural networks to approximate the drift and diffusion terms of the SDE by solving appropriate supervised learning tasks. Subsequently, we solve a steady-state Fokker-Plank equation associated with the estimated drift and diffusion coefficients with a neural-network-based least-squares method. We establish the convergence of the proposed scheme under appropriate mathematical assumptions, accounting for the generalization errors induced by regressing the drift and diffusion coefficients, and the PDE solvers. This theoretical study relies on a recent perturbation theory of Markov chain result that shows a linear dependence of the density estimation to the error in estimating the drift term, and generalization error results of nonparametric regression and of PDE regression solution obtained with neural-network models. The effectiveness of this method is reflected by numerical simulations of a two-dimensional Student's t distribution and a 20-dimensional Langevin dynamics.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningDensity EstimationregressionTime SeriesTime Series AnalysisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Density Approximation of Affine Jump Diffusions via Closed-Form Moment Matching
We develop a recursive approach for deriving closed-form solutions to both conditional and unconditional moments of affine jump diffusions with state-independent jump intensities. Using these moment solutions, we constru…
Computational EfficiencyFormTime Reversal and Last Passage Time of Diffusions with Applications to Credit Risk Management
We study time reversal, last passage time, and $h$-transform of linear diffusions. For general diffusions with killing, we obtain the probability density of the last passage time to an arbitrary level and analyze the dis…
ManagementGradient density estimation in arbitrary finite dimensions using the method of stationary phase
We prove that the density function of the gradient of a sufficiently smooth function $S : \Omega \subset \mathbb{R}^d \rightarrow \mathbb{R}$, obtained via a random variable transformation of a uniformly distributed rand…
Density EstimationConditional diffusions for amortized neural posterior estimation
Neural posterior estimation (NPE), a simulation-based computational approach for Bayesian inference, has shown great success in approximating complex posterior distributions. Existing NPE methods typically rely on normal…
Bayesian InferenceBenchmarkingOptimally adaptive Bayesian spectral density estimation for stationary and nonstationary processes
This article improves on existing methods to estimate the spectral density of stationary and nonstationary time series assuming a Gaussian process prior. By optimising an appropriate eigendecomposition using a smoothing …
Density EstimationTime SeriesTime Series Analysis