Action Mapping for Reinforcement Learning in Continuous Environments with Constraints

2024-12-05 · Mirco Theile, Lukas Dirnberger, Raphael Trumpp, Marco Caccamo, Alberto L. Sangiovanni-Vincentelli

Deep reinforcement learning (DRL) has had success across various domains, but applying it to environments with constraints remains challenging due to poor sample efficiency and slow convergence. Recent literature explored incorporating model knowledge to mitigate these problems, particularly through the use of models that assess the feasibility of proposed actions. However, integrating feasibility models efficiently into DRL pipelines in environments with continuous action spaces is non-trivial. We propose a novel DRL training strategy utilizing action mapping that leverages feasibility models to streamline the learning process. By decoupling the learning of feasible actions from policy optimization, action mapping allows DRL agents to focus on selecting the optimal action from a reduced feasible action set. We demonstrate through experiments that action mapping significantly improves training performance in constrained environments with continuous action spaces, especially with imperfect feasibility models.

📄 PDF Abstract BibTeX arXiv:2412.04327

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learning

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Grid-Mapping Pseudo-Count Constraint for Offline Reinforcement Learning

2024-04-03 · Yi Shen, Hanyan Huang

Offline reinforcement learning learns from a static dataset without interacting with environments, which ensures security and thus owns a good application prospect. However, directly applying naive reinforcement learning…

D4RL reinforcement-learning Reinforcement Learning

GRL-SNAM: Geometric Reinforcement Learning with Path Differential Hamiltonians for Simultaneous Navigation and Mapping in Unknown Environments

2025-12-31 · Aditya Sai Ellendula, Yi Wang, Minh Nguyen, Chandrajit Bajaj arxiv

We present GRL-SNAM, a geometric reinforcement learning framework for Simultaneous Navigation and Mapping(SNAM) in unknown environments. A SNAM problem is challenging as it needs to design hierarchical or joint policies …

Reinforcement Learning

SPP-RL: State Planning Policy Reinforcement Learning

2021-09-29 · Jacek Cyranka, Zuzanna Opała, Jacek Płocharczyk, Mikhail Zanka

We introduce an algorithm for reinforcement learning, in which the actor plans for the next state provided the current state. To communicate the actor output to the environment we incorporate an inverse dynamics control …

MuJoCo reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Deep reinforcement learning for weakly coupled MDP's with continuous actions

2024-06-03 · Francisco Robledo, Urtzi Ayesta, Konstantin Avrachenkov

This paper introduces the Lagrange Policy for Continuous Actions (LPCA), a reinforcement learning algorithm specifically designed for weakly coupled MDP problems with continuous action spaces. LPCA addresses the challeng…

Deep Reinforcement Learning global-optimization reinforcement-learning Reinforcement Learning

Reinforcement Learning for Robot Navigation with Adaptive Forward Simulation Time (AFST) in a Semi-Markov Model

2021-08-13 · Yu'an Chen, Ruosong Ye, Ziyang Tao, Hongjian Liu 외

Deep reinforcement learning (DRL) algorithms have proven effective in robot navigation, especially in unknown environments, by directly mapping perception inputs into robot control commands. However, most existing method…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)Robot Navigation