A Forward Propagation Algorithm for Online Optimization of Nonlinear Stochastic Differential Equations
Optimizing over the stationary distribution of stochastic differential equations (SDEs) is computationally challenging. A new forward propagation algorithm has been recently proposed for the online optimization of SDEs. The algorithm solves an SDE, derived using forward differentiation, which provides a stochastic estimate for the gradient. The algorithm continuously updates the SDE model's parameters and the gradient estimate simultaneously. This paper studies the convergence of the forward propagation algorithm for nonlinear dissipative SDEs. We leverage the ergodicity of this class of nonlinear SDEs to characterize the convergence rate of the transition semi-group and its derivatives. Then, we prove bounds on the solution of a Poisson partial differential equation (PDE) for the expected time integral of the algorithm's stochastic fluctuations around the direction of steepest descent. We then re-write the algorithm using the PDE solution, which allows us to characterize the parameter evolution around the direction of steepest descent. Our main result is a convergence theorem for the forward propagation algorithm for nonlinear dissipative SDEs.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Training Large-Scale Optical Neural Networks with Two-Pass Forward Propagation
This paper addresses the limitations in Optical Neural Networks (ONNs) related to training efficiency, nonlinear function implementation, and large input data processing. We introduce Two-Pass Forward Propagation, a nove…
Nonlinear Kalman Filtering with Divergence Minimization
We consider the nonlinear Kalman filtering problem using Kullback-Leibler (KL) and $\alpha$-divergence measures as optimization criteria. Unlike linear Kalman filters, nonlinear Kalman filters do not have closed form Gau…
Application of Complex Split-Activation Feedforward Networks to Beamforming
In increasingly congested RF environments and for jamming at closer ranges, amplifiers may introduce nonlinearities that linear adaptive beamforming techniques can’t mitigate. Machine learning architectures are intended …
A Recursive Born Approach to Nonlinear Inverse Scattering
The Iterative Born Approximation (IBA) is a well-known method for describing waves scattered by semi-transparent objects. In this paper, we present a novel nonlinear inverse scattering method that combines IBA with an ed…
Transparent objectsBackpropagation Neural Tree
We propose a novel algorithm called Backpropagation Neural Tree (BNeuralT), which is a stochastic computational dendritic tree. BNeuralT takes random repeated inputs through its leaves and imposes dendritic nonlinearitie…
DescriptiveImage Classification