RayNet: A Simulation Platform for Developing Reinforcement Learning-Driven Network Protocols
Reinforcement Learning (RL) has gained significant momentum in the development of network protocols. However, RL-based protocols are still in their infancy, and substantial research is required to build deployable solutions. Developing a protocol based on RL is a complex and challenging process that involves several model design decisions and requires significant training and evaluation in real and simulated network topologies. Network simulators offer an efficient training environment for RL-based protocols, because they are deterministic and can run in parallel. In this paper, we introduce \textit{RayNet}, a scalable and adaptable simulation platform for the development of RL-based network protocols. RayNet integrates OMNeT++, a fully programmable network simulator, with Ray/RLlib, a scalable training platform for distributed RL. RayNet facilitates the methodical development of RL-based network protocols so that researchers can focus on the problem at hand and not on implementation details of the learning aspect of their research. We developed a simple RL-based congestion control approach as a proof of concept showcasing that RayNet can be a valuable platform for RL-based research in computer networks, enabling scalable training and evaluation. We compared RayNet with \textit{ns3-gym}, a platform with similar objectives to RayNet, and showed that RayNet performs better in terms of how fast agents can collect experience in RL environments.
Code (1)
Tasks
reinforcement-learningReinforcement Learning (RL)rllibSimilar Papers 제목 키워드 기반
RayNet: Learning Volumetric 3D Reconstruction with Ray Potentials
In this paper, we consider the problem of reconstructing a dense 3D model using images captured from different views. Recent methods based on convolutional neural networks (CNN) allow learning the entire task from data. …
3D ReconstructionMeta-Generalization for Multiparty Privacy Learning to Identify Anomaly Multimedia Traffic in Graynet
Identifying anomaly multimedia traffic in cyberspace is a big challenge in distributed service systems, multiple generation networks and future internet of everything. This letter explores meta-generalization for a multi…
BEAR: Physics-Principled Building Environment for Control and Reinforcement Learning
Recent advancements in reinforcement learning algorithms have opened doors for researchers to operate and optimize building energy management systems autonomously. However, the lack of an easily configurable building dyn…
energy managementManagementModel Predictive Controlreinforcement-learning+2Data-Driven Simulation of Ride-Hailing Services using Imitation and Reinforcement Learning
The rapid growth of ride-hailing platforms has created a highly competitive market where businesses struggle to make profits, demanding the need for better operational strategies. However, real-world experiments are risk…
Imitation Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Efficient Climate Simulation via Machine Learning Method
Hybrid modeling combining data-driven techniques and numerical methods is an emerging and promising research direction for efficient climate simulation. However, previous works lack practical platforms, making developing…