Sample-efficient Cross-Entropy Method for Real-time Planning
Trajectory optimizers for model-based reinforcement learning, such as the Cross-Entropy Method (CEM), can yield compelling results even in high-dimensional control tasks and sparse-reward environments. However, their sampling inefficiency prevents them from being used for real-time planning and control. We propose an improved version of the CEM algorithm for fast planning, with novel additions including temporally-correlated actions and memory, requiring 2.7-22x less samples and yielding a performance increase of 1.2-10x in high-dimensional control problems.
Code (1)
Tasks
Model-based Reinforcement Learningreinforcement-learningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Sample-efficient Real-time Planning with Curiosity Cross-Entropy Method and Contrastive Learning
Model-based reinforcement learning (MBRL) with real-time planning has shown great potential in locomotion and manipulation control tasks. However, the existing planning methods, such as the Cross-Entropy Method (CEM), do…
continuous-controlContinuous ControlContrastive LearningModel-based Reinforcement Learning+1Sample-efficient Low-level Motion Planning for Robotic Manipulation Tasks via Zero-shot Transfer Learning
As robotic systems become more sophisticated, the growing complexity of their motion planning models and the longer training times pose substantial challenges. Evolutionary algorithms such as the Sample-efficient Cross-E…
Transfer LearningMotion PlanningDeepPlanner: Scaling Planning Capability for Deep Research Agents via Advantage Shaping
Large language models (LLMs) augmented with multi-step reasoning and action generation abilities have shown promise in leveraging external tools to tackle complex tasks that require long-horizon planning. However, existi…
Reinforcement LearningCEM-GD: Cross-Entropy Method with Gradient Descent Planner for Model-Based Reinforcement Learning
Current state-of-the-art model-based reinforcement learning algorithms use trajectory sampling methods, such as the Cross-Entropy Method (CEM), for planning in continuous control settings. These zeroth-order optimizers r…
continuous-controlContinuous ControlModel-based Reinforcement LearningMuJoCo+1Model Tensor Planning
Sampling-based model predictive control (MPC) offers strong performance in nonlinear and contact-rich robotic tasks, yet often suffers from poor exploration due to locally greedy sampling schemes. We propose \emph{Model …
modelModel Predictive ControlMuJoCo