Safe Exploration of State and Action Spaces in Reinforcement Learning

2014-02-04 · Javier Garcia, Fernando Fernandez

In this paper, we consider the important problem of safe exploration in reinforcement learning. While reinforcement learning is well-suited to domains with complex transition dynamics and high-dimensional state-action spaces, an additional challenge is posed by the need for safe and efficient exploration. Traditional exploration techniques are not particularly useful for solving dangerous tasks, where the trial and error process may lead to the selection of actions whose execution in some states may result in damage to the learning system (or any other system). Consequently, when an agent begins an interaction with a dangerous and high-dimensional state-action space, an important question arises; namely, that of how to avoid (or at least minimize) damage caused by the exploration of the state-action space. We introduce the PI-SRL algorithm which safely improves suboptimal albeit robust behaviors for continuous state and action control tasks and which efficiently learns from the experience gained from the environment. We evaluate the proposed method in four complex tasks: automatic car parking, pole-balancing, helicopter hovering, and business management.

📄 PDF Abstract BibTeX arXiv:1402.0560

Code (0)

등록된 구현이 없습니다.

Tasks

Efficient ExplorationManagement reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Exploration

Safety-Guided Deep Reinforcement Learning via Online Gaussian Process Estimation

2019-03-06 · Jiameng Fan, Wenchao Li

An important facet of reinforcement learning (RL) has to do with how the agent goes about exploring the environment. Traditional exploration strategies typically focus on efficiency and ignore safety. However, for practi…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Specialized Deep Residual Policy Safe Reinforcement Learning-Based Controller for Complex and Continuous State-Action Spaces

2023-10-15 · Ammar N. Abbas, Georgios C. Chasparis, John D. Kelleher

Traditional controllers have limitations as they rely on prior knowledge about the physics of the problem, require modeling of dynamics, and struggle to adapt to abnormal situations. Deep reinforcement learning has the p…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Safe Reinforcement Learning

Platform-Agnostic Reinforcement Learning Framework for Safe Exploration of Cluttered Environments with Graph Attention

2025-11-19 · Gabriele Calzolari, Vidya Sumathy, Christoforos Kanellakis, George Nikolakopoulos arxiv

Autonomous exploration of obstacle-rich spaces requires strategies that ensure efficiency while guaranteeing safety against collisions with obstacles. This paper investigates a novel platform-agnostic reinforcement learn…

Reinforcement Learning Graph Neural Network

Neurosymbolic Reinforcement Learning with Formally Verified Exploration

2020-09-26 · NeurIPS 2020 12 · Greg Anderson, Abhinav Verma, Isil Dillig, Swarat Chaudhuri

We present Revel, a partially neural reinforcement learning (RL) framework for provably safe exploration in continuous state and action spaces. A key challenge for provably safe deep RL is that repeatedly verifying neura…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Exploration

Safe deep reinforcement learning-based constrained optimal control scheme for active distribution networks

2020-04-15 · Elsevier Applied Energy 2020 4 · Peng Kou, Deliang Liang, Chen Wang, Zihao Wu 외

Reinforcement learning-based schemes are being recently applied for model-free voltage control in active distribution networks. However, existing reinforcement learning methods face challenges when it comes to continuous…