An open source Multi-Agent Deep Reinforcement Learning Routing Simulator for satellite networks

2024-07-08 · Federico Lozano-Cuadra, Mathias D. Thorsager, Israel Leyva-Mayorga, Beatriz Soret

This paper introduces an open source simulator for packet routing in Low Earth Orbit Satellite Constellations (LSatCs) considering the dynamic system uncertainties. The simulator, implemented in Python, supports traditional Dijkstra's based routing as well as more advanced learning solutions, specifically Q-Routing and Multi-Agent Deep Reinforcement Learning (MA-DRL) from our previous work. It uses an event-based approach with the SimPy module to accurately simulate packet creation, routing and queuing, providing real-time tracking of queues and latency. The simulator is highly configurable, allowing adjustments in routing policies, traffic, ground and space layer topologies, communication parameters, and learning hyperparameters. Key features include the ability to visualize system motion and track packet paths. Results highlight significant improvements in end-to-end (E2E) latency using Reinforcement Learning (RL)-based routing policies compared to traditional methods. The source code, the documentation and a Jupyter notebook with post-processing results and analysis are available on GitHub.

📄 PDF Abstract BibTeX arXiv:2407.11047

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

HierRouter: Coordinated Routing of Specialized Large Language Models via Reinforcement Learning

2025-11-13 · Nikunj Gupta, Bill Guo, Rajgopal Kannan, Viktor K. Prasanna arxiv

Large Language Models (LLMs) deliver state-of-the-art performance across many tasks but impose high computational and memory costs, limiting their deployment in resource-constrained or real-time settings. To address this…

Reinforcement Learning Mathematical Reasoning Code Generation

XRoute Environment: A Novel Reinforcement Learning Environment for Routing

2023-05-23 · Zhanwen Zhou, Hankz Hankui Zhuo, Xiaowu Zhang, Qiyuan Deng

Routing is a crucial and time-consuming stage in modern design automation flow for advanced technology nodes. Great progress in the field of reinforcement learning makes it possible to use those approaches to improve the…

reinforcement-learning Reinforcement Learning

Multi-Agent Environments for Vehicle Routing Problems

2024-11-21 · Ricardo Gama, Daniel Fuertes, Carlos R. del-Blanco, Hugo L. Fernandes

Research on Reinforcement Learning (RL) approaches for discrete optimization problems has increased considerably, extending RL to an area classically dominated by Operations Research (OR). Vehicle routing problems are a …

Benchmarking reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Adaptive routing protocols for determining optimal paths in AI multi-agent systems: a priority- and learning-enhanced approach

2025-03-10 · Theodor Panayotov, Ivo Emanuilov

As distributed artificial intelligence (AI) and multi-agent architectures grow increasingly complex, the need for adaptive, context-aware routing becomes paramount. This paper introduces an enhanced, adaptive routing alg…

Reinforcement Learning (RL)

AgentGate: A Lightweight Structured Routing Engine for the Internet of Agents

2026-04-08 · Yujun Cheng, Enfang Cui, Hao Qin, Zhiyuan Liang 외 arxiv

The rapid development of AI agent systems is leading to an emerging Internet of Agents, where specialized agents operate across local devices, edge nodes, private services, and cloud platforms. Although recent efforts ha…

Text Generation