Reinforcement Learning for Dynamic Resource Allocation in Optical Networks: Hype or Hope?

2025-02-18 · Michael Doherty, Robin Matzner, Rasoul Sadeghi, Polina Bayvel, Alejandra Beghelli

The application of reinforcement learning (RL) to dynamic resource allocation in optical networks has been the focus of intense research activity in recent years, with almost 100 peer-reviewed papers. We present a review of progress in the field, and identify significant gaps in benchmarking practices and reproducibility. To determine the strongest benchmark algorithms, we systematically evaluate several heuristics across diverse network topologies. We find that path count and sort criteria for path selection significantly affect the benchmark performance. We meticulously recreate the problems from five landmark papers and apply the improved benchmarks. Our comparisons demonstrate that simple heuristics consistently match or outperform the published RL solutions, often with an order of magnitude lower blocking probability. Furthermore, we present empirical lower bounds on network blocking using a novel defragmentation-based method, revealing that potential improvements over the benchmark heuristics are limited to 19-36% increased traffic load for the same blocking performance in our examples. We make our simulation framework and results publicly available to promote reproducible research and standardized evaluation https://doi.org/10.5281/zenodo.12594495.

📄 PDF Abstract BibTeX arXiv:2502.12804

Code (1)

micdoh/XLRON 공식 구현 jax

Tasks

Benchmarking Blocking Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Focus 설명 없음

A Two-stage Reinforcement Learning-based Approach for Multi-entity Task Allocation

2024-06-29 · Aicheng Gong, Kai Yang, Jiafei Lyu, Xiu Li

Task allocation is a key combinatorial optimization problem, crucial for modern applications such as multi-robot cooperation and resource scheduling. Decision makers must allocate entities to tasks reasonably across diff…

Combinatorial Optimization reinforcement-learning Reinforcement Learning Scheduling+1

Resource Allocation in Multicore Elastic Optical Networks: A Deep Reinforcement Learning Approach

2022-07-05 · Juan Pinto-Ríos, Felipe Calderón, Ariel Leiva, Gabriel Hermosilla 외

A deep reinforcement learning approach is applied, for the first time, to solve the routing, modulation, spectrum and core allocation (RMSCA) problem in dynamic multicore fiber elastic optical networks (MCF-EONs). To do …

Blocking Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Network Aware Compute and Memory Allocation in Optically Composable Data Centres with Deep Reinforcement Learning and Graph Neural Networks

2022-10-26 · Zacharaya Shabka, Georgios Zervas

Resource-disaggregated data centre architectures promise a means of pooling resources remotely within data centres, allowing for both more flexibility and resource efficiency underlying the increasingly important infrast…

Deep Reinforcement Learning Graph Neural Network

Reinforcement Learning for Resource Allocation in Steerable Laser-based Optical Wireless Systems

2021-06-21 · Abdelrahman S. Elgamal, Osama Z. Alsulami, Ahmad Adnan Qidan, Taisir E. H. El-Gorashi 외

Vertical Cavity Surface Emitting Lasers (VCSELs) have demonstrated suitability for data transmission in indoor optical wireless communication (OWC) systems due to the high modulation bandwidth and low manufacturing cost …

Management Q-Learning reinforcement-learning Reinforcement Learning (RL)

Deep Reinforcement Learning for Dynamic Resource Allocation in Wireless Networks

2025-02-03 · Shubham Malhotra, Fnu Yashu, Muhammad Saqib, Dipkumar Mehta 외

This report investigates the application of deep reinforcement learning (DRL) algorithms for dynamic resource allocation in wireless communication systems. An environment that includes a base station, multiple antennas, …

Deep Reinforcement Learning rllib Scheduling