RLlib: Abstractions for Distributed Reinforcement Learning
Reinforcement learning (RL) algorithms involve the deep nesting of highly irregular computation patterns, each of which typically exhibits opportunities for distributed computation. We argue for distributing RL components in a composable way by adapting algorithms for top-down hierarchical control, thereby encapsulating parallelism and resource requirements within short-running compute tasks. We demonstrate the benefits of this principle through RLlib: a library that provides scalable software primitives for RL. These primitives enable a broad range of algorithms to be implemented with high performance, scalability, and substantial code reuse. RLlib is available at https://rllib.io/.
Code (3)
Tasks
reinforcement-learningReinforcement LearningReinforcement Learning (RL)rllibSimilar Papers 제목 키워드 기반
RLlib Flow: Distributed Reinforcement Learning is a Dataflow Problem
Researchers and practitioners in the field of reinforcement learning (RL) frequently leverage parallel computation, which has led to a plethora of new algorithms and systems in the last few years. In this paper, we re-ex…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)rllibScalable Volt-VAR Optimization using RLlib-IMPALA Framework: A Reinforcement Learning Approach
In the rapidly evolving domain of electrical power systems, the Volt-VAR optimization (VVO) is increasingly critical, especially with the burgeoning integration of renewable energy sources. Traditional approaches to lear…
Deep Reinforcement LearningDistributed Computingreinforcement-learningReinforcement Learning+1MARLlib: A Scalable and Efficient Multi-agent Reinforcement Learning Library
A significant challenge facing researchers in the area of multi-agent reinforcement learning (MARL) pertains to the identification of a library that can offer fast and compatible development for multi-agent tasks and alg…
Multi-agent Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Wireless MAC Protocol Synthesis and Optimization with Multi-Agent Distributed Reinforcement Learning
In this letter, we propose a novel Multi-Agent Deep Reinforcement Learning (MADRL) framework for Medium Access Control (MAC) protocol design. Unlike centralized approaches, which rely on a single entity for decision-maki…
Decision MakingDeep Reinforcement LearningrllibPOPGym: Benchmarking Partially Observable Reinforcement Learning
Real world applications of Reinforcement Learning (RL) are often partially observable, thus requiring memory. Despite this, partial observability is still largely ignored by contemporary RL benchmarks and libraries. We i…
BenchmarkingGPUPartially Observable Reinforcement Learningreinforcement-learning+4