paper-with-me

홈 › Papers

Trajectory First: A Curriculum for Discovering Diverse Policies

2025-06-02 · Cornelius V. Braun, Sayantan Auddy, Marc Toussaint

Being able to solve a task in diverse ways makes agents more robust to task variations and less prone to local optima. In this context, constrained diversity optimization has emerged as a powerful reinforcement learning (RL) framework to train a diverse set of agents in parallel. However, existing constrained-diversity RL methods often under-explore in complex tasks such as robotic manipulation, leading to a lack in policy diversity. To improve diversity optimization in RL, we therefore propose a curriculum that first explores at the trajectory level before learning step-based policies. In our empirical evaluation, we provide novel insights into the shortcoming of skill-based diversity optimization, and demonstrate empirically that our curriculum improves the diversity of the learned skills.

📄 PDF Abstract BibTeX arXiv:2506.01568

Code (0)

등록된 구현이 없습니다.

Tasks

DiversityReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Trajectory-Level Automatic Curriculum Learning for Legged Locomotion on Unstructured Terrain

2026-08-17 · Rocky Liu, Tengyu Liu, Baoxiong Jia, Fangwei Zhong 외 arxiv

Training locomotion policies for complex unstructured terrain requires a curriculum to avoid early exploration failures. However, since unstructured terrain lacks explicit difficulty ordering for curriculum design, exist…

Discovering Behavioral Modes in Deep Reinforcement Learning Policies Using Trajectory Clustering in Latent Space

2024-02-20 · Sindre Benjamin Remman, Anastasios M. Lekkas

Understanding the behavior of deep reinforcement learning (DRL) agents is crucial for improving their performance and reliability. However, the complexity of their policies often makes them challenging to understand. In …

ClusteringDeep Reinforcement LearningDimensionality ReductionTrajectory Clustering

Guided Curriculum Learning for Walking Over Complex Terrain

2020-10-08 · Brendan Tidd, Nicolas Hudson, Akansel Cosgun

Reliable bipedal walking over complex terrain is a challenging problem, using a curriculum can help learning. Curriculum learning is the idea of starting with an achievable version of a task and increasing the difficulty…

Deep Reinforcement Learning

Learning Getting-Up Policies for Real-World Humanoid Robots

2025-02-17 · Xialin He, Runpei Dong, Zixuan Chen, Saurabh Gupta

Automatic fall recovery is a crucial prerequisite before humanoid robots can be reliably deployed. Hand-designing controllers for getting up is difficult because of the varied configurations a humanoid can end up in afte…

Continuously Discovering Novel Strategies via Reward-Switching Policy Optimization

2022-04-04 · ICLR 2022 4 · Zihan Zhou, Wei Fu, Bingliang Zhang, Yi Wu

We present Reward-Switching Policy Optimization (RSPO), a paradigm to discover diverse strategies in complex RL environments by iteratively finding novel policies that are both locally optimal and sufficiently different …

continuous-controlContinuous ControlDiversityMuJoCo