paper-with-me

홈 › Papers

Robust and Efficient MuJoCo-based Model Predictive Control via Web of Affine Spaces Derivatives

2025-12-24 · Chen Liang, Daniel Rakita arxiv

MuJoCo is a powerful and efficient physics simulator widely used in robotics. One common way it is applied in practice is through Model Predictive Control (MPC), which uses repeated rollouts of the simulator to optimize future actions and generate responsive control policies in real time. To make this process more accessible, the open source library MuJoCo MPC (MJPC) provides ready-to-use MPC algorithms and implementations built directly on top of the MuJoCo simulator. However, MJPC relies on finite differencing (FD) to compute derivatives through the underlying MuJoCo simulator, which is often a key bottleneck that can make it prohibitively costly for time-sensitive tasks, especially in high-DOF systems or complex scenes. In this paper, we introduce the use of Web of Affine Spaces (WASP) derivatives within MJPC as a drop-in replacement for FD. WASP is a recently developed approach for efficiently computing sequences of accurate derivative approximations. By reusing information from prior, related derivative calculations, WASP accelerates and stabilizes the computation of new derivatives, making it especially well suited for MPC's iterative, fine-grained updates over time. We evaluate WASP across a diverse suite of MJPC tasks spanning multiple robot embodiments. Our results suggest that WASP derivatives are particularly effective in MJPC: it integrates seamlessly across tasks, delivers consistently robust performance, and achieves up to a 2$\mathsf{x}$ speedup compared to an FD backend when used with derivative-based planners, such as iLQG. In addition, WASP-based MPC outperforms MJPC's stochastic sampling-based planners on our evaluation tasks, offering both greater efficiency and reliability. To support adoption and future research, we release an open-source implementation of MJPC with WASP derivatives fully integrated.

📄 PDF Abstract BibTeX arXiv:2512.21109

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Handling Hard Affine SDP Shape Constraints in RKHSs

2021-01-05 · Pierre-Cyril Aubin-Frankowski, Zoltan Szabo

Shape constraints, such as non-negativity, monotonicity, convexity or supermodularity, play a key role in various applications of machine learning and statistics. However, incorporating this side information into predict…

Econometrics

Adaptive Legged Locomotion via Online Learning for Model Predictive Control

2025-10-17 · Hongyu Zhou, Xiaoyu Zhang, Vasileios Tzoumas arxiv

We provide an algorithm for adaptive legged locomotion via online learning and model predictive control. The algorithm is composed of two interacting modules: model predictive control (MPC) and online learning of residua…

Bridging Physics-Informed Neural Networks with Reinforcement Learning: Hamilton-Jacobi-Bellman Proximal Policy Optimization (HJBPPO)

2023-02-01 · Amartya Mukherjee, Jun Liu

This paper introduces the Hamilton-Jacobi-Bellman Proximal Policy Optimization (HJBPPO) algorithm into reinforcement learning. The Hamilton-Jacobi-Bellman (HJB) equation is used in control theory to evaluate the optimali…

MuJoCoreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Time-inhomogeneous affine processes and affine market models

2015-12-10

This thesis is devoted to the study of affine processes and their applications in financial mathematics. In the first part we consider the theory of time-inhomogeneous affine processes on general state spaces. We present…

Computationally efficient Gauss-Newton reinforcement learning for model predictive control

2025-08-04 · Dean Brandner, Sebastien Gros, Sergio Lucia arxiv

Model predictive control (MPC) is widely used in process control due to its interpretability and ability to handle constraints. As a parametric policy in reinforcement learning (RL), MPC offers strong initial performance…

Reinforcement Learning