Interactive Parallel Exploration for Reinforcement Learning in Continuous Action Spaces

2018-09-27 · Whiyoung Jung, Giseung Park, Youngchul Sung

In this paper, a new interactive parallel learning scheme is proposed to enhance the performance of off-policy continuous-action reinforcement learning. In the proposed interactive parallel learning scheme, multiple identical learners with their own value-functions and policies share a common experience replay buffer, and search a good policy in collaboration with the guidance of the best policy information. The information of the best policy is fused in a soft manner by constructing an augmented loss function for policy update to enlarge the overall search space by the multiple learners. The guidance by the previous best policy and the enlarged search space by the proposed interactive parallel learning scheme enable faster and better policy search in the policy parameter space. Working algorithms are constructed by applying the proposed interactive parallel learning scheme to several off-policy reinforcement learning algorithms such as the twin delayed deep deterministic (TD3) policy gradient algorithm and the soft actor-critic (SAC) algorithm, and numerical results show that the constructed IPE-enhanced algorithms outperform most of the current state-of-the-art reinforcement learning algorithms for continuous action control.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Failing to Explore: Language Models on Interactive Tasks

2026-01-29 · Mahdi JafariRaviz, Keivan Rezaei, Arshia Soltani Moakhar, Zahra Sodagar 외 arxiv

We evaluate language models on their ability to explore interactive environments under a limited interaction budget. We introduce three parametric tasks with controllable exploration difficulty, spanning continuous and d…

Active exploration in parameterized reinforcement learning

2016-10-06 · Mehdi Khamassi, Costas Tzafestas

Online model-free reinforcement learning (RL) methods with continuous actions are playing a prominent role when dealing with real-world applications such as Robotics. However, when confronted to non-stationary environmen…

Meta-Learning Q-Learning reinforcement-learning Reinforcement Learning+1

K-Myriad: Jump-starting reinforcement learning with unsupervised parallel agents

2026-01-26 · Vincenzo De Paola, Mirco Mutti, Riccardo Zamboni, Marcello Restelli arxiv

Parallelization in Reinforcement Learning is typically employed to speed up the training of a single policy, where multiple workers collect experience from an identical sampling distribution. This common design limits th…

Reinforcement Learning Continuous Control

Foundations of Reinforcement Learning and Interactive Decision Making

2023-12-27 · Dylan J. Foster, Alexander Rakhlin

These lecture notes give a statistical perspective on the foundations of reinforcement learning and interactive decision making. We present a unifying framework for addressing the exploration-exploitation dilemma using f…

Decision Making Multi-Armed Bandits reinforcement-learning Reinforcement Learning

Langevin Soft Actor-Critic: Efficient Exploration through Uncertainty-Driven Critic Learning

2025-01-29 · Haque Ishfaq, Guangyuan Wang, Sami Nur Islam, Doina Precup

Existing actor-critic algorithms, which are popular for continuous control reinforcement learning (RL) tasks, suffer from poor sample efficiency due to lack of principled exploration mechanism within them. Motivated by t…

continuous-control Continuous Control Efficient Exploration Reinforcement Learning (RL)+1