Accelerating Deep Reinforcement Learning for Digital Twin Network Optimization with Evolutionary Strategies
The recent growth of emergent network applications (e.g., satellite networks, vehicular networks) is increasing the complexity of managing modern communication networks. As a result, the community proposed the Digital Twin Networks (DTN) as a key enabler of efficient network management. Network operators can leverage the DTN to perform different optimization tasks (e.g., Traffic Engineering, Network Planning). Deep Reinforcement Learning (DRL) showed a high performance when applied to solve network optimization problems. In the context of DTN, DRL can be leveraged to solve optimization problems without directly impacting the real-world network behavior. However, DRL scales poorly with the problem size and complexity. In this paper, we explore the use of Evolutionary Strategies (ES) to train DRL agents for solving a routing optimization problem. The experimental results show that ES achieved a training time speed-up of 128 and 6 for the NSFNET and GEANT2 topologies respectively.
Code (1)
Tasks
Deep Reinforcement LearningManagementreinforcement-learningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Digital Twin Aided Channel Estimation: Zone-Specific Subspace Prediction and Calibration
Effective channel estimation in sparse and high-dimensional environments is essential for next-generation wireless systems, particularly in large-scale MIMO deployments. This paper introduces a novel framework that lever…
Reinforcement Learning (RL)Digital Twin-Enhanced Deep Reinforcement Learning for Resource Management in Networks Slicing
Network slicing-based communication systems can dynamically and efficiently allocate resources for diversified services. However, due to the limitation of the network interface on channel access and the complexity of the…
Deep Reinforcement LearningManagementreinforcement-learningReinforcement LearningReinforcement Twinning: from digital twins to model-based reinforcement learning
Digital twins promise to revolutionize engineering by offering new avenues for optimization, control, and predictive maintenance. We propose a novel framework for simultaneously training the digital twin of an engineerin…
Model-based Reinforcement Learningreinforcement-learningReinforcement LearningA Brief History of Digital Twin Technology
Emerging from NASA's spacecraft simulations in the 1960s, digital twin technology has advanced through industrial adoption to spark a healthcare transformation. A digital twin is a dynamic, data-driven virtual counterpar…
Federated LearningDrug DiscoveryUncertainty-Aware Digital Twins: Robust Model Predictive Control using Time-Series Deep Quantile Learning
Digital Twins, virtual replicas of physical systems that enable real-time monitoring, model updates, predictions, and decision-making, present novel avenues for proactive control strategies for autonomous systems. Howeve…
Decision MakingModel Predictive Controlquantile regressionTime Series+1