paper-with-me

홈 › Papers

Natural Gradient Descent for Control

2025-03-08 · Ramin Esmzad, Farnaz Adib Yaghmaie, Hamidreza Modares

This paper bridges optimization and control, and presents a novel closed-loop control framework based on natural gradient descent, offering a trajectory-oriented alternative to traditional cost-function tuning. By leveraging the Fisher Information Matrix, we formulate a preconditioned gradient descent update that explicitly shapes system trajectories. We show that, in sharp contrast to traditional controllers, our approach provides flexibility to shape the system's low-level behavior. To this end, the proposed method parameterizes closed-loop dynamics in terms of stationary covariance and an unknown cost function, providing a geometric interpretation of control adjustments. We establish theoretical stability conditions. The simulation results on a rotary inverted pendulum benchmark highlight the advantages of natural gradient descent in trajectory shaping.

📄 PDF Abstract BibTeX arXiv:2503.06070

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Natural Gradient Descent 설명 없음

Similar Papers 제목 키워드 기반

Stochastic natural gradient descent draws posterior samples in function space

2018-06-25 · Samuel L. Smith, Daniel Duckworth, Semon Rezchikov, Quoc V. Le 외

Recent work has argued that stochastic gradient descent can approximate the Bayesian uncertainty in model parameters near local minima. In this work we develop a similar correspondence for minibatch natural gradient desc…

valid

Policy Gradient-based Algorithms for Continuous-time Linear Quadratic Control

2020-06-12

We consider the continuous-time Linear-Quadratic-Regulator (LQR) problem in terms of optimizing a real-valued matrix function over the set of feedback gains. The results developed are in parallel to those in Bu et al. [1…

True Asymptotic Natural Gradient Optimization

2017-12-22 · Yann Ollivier

We introduce a simple algorithm, True Asymptotic Natural Gradient Optimization (TANGO), that converges to a true natural gradient descent in the limit of small learning rates, without explicit Fisher matrix estimation. …

Structured second-order methods via natural gradient descent

2021-07-22 · Wu Lin, Frank Nielsen, Mohammad Emtiyaz Khan, Mark Schmidt

In this paper, we propose new structured second-order methods and structured adaptive-gradient methods obtained by performing natural-gradient descent on structured parameter spaces. Natural-gradient descent is an attrac…

Second-order methods

ONG: Orthogonal Natural Gradient Descent

2025-08-24 · Yajat Yadav, Patrick Mendoza, Jathin Korrapati arxiv

Orthogonal Gradient Descent (OGD) has emerged as a powerful method for continual learning. However, its Euclidean projections do not leverage the underlying information-geometric structure of the problem, which can lead …

Continual LearningRotated MNIST