Symbolic Reinforcement Learning for Safe RAN Control

2021-03-11 · Alexandros Nikou, Anusha Mujumdar, Marin Orlic, Aneta Vulgarakis Feljan

In this paper, we demonstrate a Symbolic Reinforcement Learning (SRL) architecture for safe control in Radio Access Network (RAN) applications. In our automated tool, a user can select a high-level safety specifications expressed in Linear Temporal Logic (LTL) to shield an RL agent running in a given cellular network with aim of optimizing network performance, as measured through certain Key Performance Indicators (KPIs). In the proposed architecture, network safety shielding is ensured through model-checking techniques over combined discrete system models (automata) that are abstracted through reinforcement learning. We demonstrate the user interface (UI) helping the user set intent specifications to the architecture and inspect the difference in allowed and blocked actions.

📄 PDF Abstract BibTeX arXiv:2103.06602

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Safe RAN control: A Symbolic Reinforcement Learning Approach

2021-06-03 · Alexandros Nikou, Anusha Mujumdar, Vaishnavi Sundararajan, Marin Orlic 외

In this paper, we present a Symbolic Reinforcement Learning (SRL) based architecture for safety control of Radio Access Network (RAN) applications. In particular, we provide a purely automated procedure in which a user c…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Self-Learning

safe-control-gym: a Unified Benchmark Suite for Safe Learning-based Control and Reinforcement Learning in Robotics

2021-09-13 · Zhaocong Yuan, Adam W. Hall, SiQi Zhou, Lukas Brunke 외

In recent years, both reinforcement learning and learning-based control -- as well as the study of their safety, which is crucial for deployment in real-world robots -- have gained significant traction. However, to adequ…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Guiding Safe Exploration with Weakest Preconditions

2022-09-28 · Greg Anderson, Swarat Chaudhuri, Isil Dillig

In reinforcement learning for safety-critical settings, it is often desirable for the agent to obey safety constraints at all points in time, including during training. We present a novel neurosymbolic approach called SP…

continuous-control Continuous Control reinforcement-learning Reinforcement Learning (RL)+1

Neurosymbolic Meta-Reinforcement Lookahead Learning Achieves Safe Self-Driving in Non-Stationary Environments

2023-09-05 · Haozhe Lei, Quanyan Zhu

In the area of learning-driven artificial intelligence advancement, the integration of machine learning (ML) into self-driving (SD) technology stands as an impressive engineering feat. Yet, in real-world applications out…

Meta Reinforcement Learning

Neurosymbolic Reinforcement Learning with Formally Verified Exploration

2020-09-26 · NeurIPS 2020 12 · Greg Anderson, Abhinav Verma, Isil Dillig, Swarat Chaudhuri

We present Revel, a partially neural reinforcement learning (RL) framework for provably safe exploration in continuous state and action spaces. A key challenge for provably safe deep RL is that repeatedly verifying neura…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Exploration