Accelerating Model-Based Reinforcement Learning using Non-Linear Trajectory Optimization

2025-06-03 · Marco Calì, Giulio Giacomuzzo, Ruggero Carli, Alberto Dalla Libera

This paper addresses the slow policy optimization convergence of Monte Carlo Probabilistic Inference for Learning Control (MC-PILCO), a state-of-the-art model-based reinforcement learning (MBRL) algorithm, by integrating it with iterative Linear Quadratic Regulator (iLQR), a fast trajectory optimization method suitable for nonlinear systems. The proposed method, Exploration-Boosted MC-PILCO (EB-MC-PILCO), leverages iLQR to generate informative, exploratory trajectories and initialize the policy, significantly reducing the number of required optimization steps. Experiments on the cart-pole task demonstrate that EB-MC-PILCO accelerates convergence compared to standard MC-PILCO, achieving up to $\bm{45.9\%}$ reduction in execution time when both methods solve the task in four trials. EB-MC-PILCO also maintains a $\bm{100\%}$ success rate across trials while solving the task faster, even in cases where MC-PILCO converges in fewer iterations.

📄 PDF Abstract BibTeX arXiv:2506.02767

Code (0)

등록된 구현이 없습니다.

Tasks

Model-based Reinforcement Learning

Active MR k-space Sampling with Reinforcement Learning

2020-07-20 · Luis Pineda, Sumana Basu, Adriana Romero, Roberto Calandra 외

Deep learning approaches have recently shown great promise in accelerating magnetic resonance image (MRI) acquisition. The majority of existing work have focused on designing better reconstruction models given a pre-dete…

Image Reconstruction reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Local Policy Optimization for Trajectory-Centric Reinforcement Learning

2020-01-22 · Patrik Kolaric, Devesh K. Jha, Arvind U. Raghunathan, Frank L. Lewis 외

The goal of this paper is to present a method for simultaneous trajectory and local stabilizing policy optimization to generate local policies for trajectory-centric model-based reinforcement learning (MBRL). This is mot…

Model-based Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Autonomous overtaking trajectory optimization using reinforcement learning and opponent pose estimation

2026-03-28 · Matej Rene Cihlar, Luka Šiktar, Branimir Ćaran, Marko Švaco arxiv

Vehicle overtaking is one of the most complex driving maneuvers for autonomous vehicles. To achieve optimal autonomous overtaking, driving systems rely on multiple sensors that enable safe trajectory optimization and ove…

Reinforcement Learning Autonomous Vehicles Object Detection Pose Estimation

Chance-Constrained Trajectory Optimization for Non-linear Systems with Unknown Stochastic Dynamics

2019-07-31

Iterative trajectory optimization techniques for non-linear dynamical systems are among the most powerful and sample-efficient methods of model-based reinforcement learning and approximate optimal control. By leveraging …

Model-based Reinforcement Learning

In-Trajectory Inverse Reinforcement Learning: Learn Incrementally Before An Ongoing Trajectory Terminates

2024-10-21 · Shicheng Liu, Minghui Zhu

Inverse reinforcement learning (IRL) aims to learn a reward function and a corresponding policy that best fit the demonstrated trajectories of an expert. However, current IRL works cannot learn incrementally from an ongo…