XRoute Environment: A Novel Reinforcement Learning Environment for Routing

2023-05-23 · Zhanwen Zhou, Hankz Hankui Zhuo, Xiaowu Zhang, Qiyuan Deng

Routing is a crucial and time-consuming stage in modern design automation flow for advanced technology nodes. Great progress in the field of reinforcement learning makes it possible to use those approaches to improve the routing quality and efficiency. However, the scale of the routing problems solved by reinforcement learning-based methods in recent studies is too small for these methods to be used in commercial EDA tools. We introduce the XRoute Environment, a new reinforcement learning environment where agents are trained to select and route nets in an advanced, end-to-end routing framework. Novel algorithms and ideas can be quickly tested in a safe and reproducible manner in it. The resulting environment is challenging, easy to use, customize and add additional scenarios, and it is available under a permissive open-source license. In addition, it provides support for distributed deployment and multi-instance experiments. We propose two tasks for learning and build a full-chip test bed with routing benchmarks of various region sizes. We also pre-define several static routing regions with different pin density and number of nets for easier learning and testing. For net ordering task, we report baseline results for two widely used reinforcement learning algorithms (PPO and DQN) and one searching-based algorithm (TritonRoute). The XRoute Environment will be available at https://github.com/xplanlab/xroute_env.

📄 PDF Abstract BibTeX arXiv:2305.13823

Code (1)

xplanlab/xroute_env 공식 구현 pytorch

Tasks

reinforcement-learning Reinforcement Learning

Methods 이 논문이 사용한 방법론

Test 설명 없음

xRouter: Training Cost-Aware LLMs Orchestration System via Reinforcement Learning

2025-10-09 · Cheng Qian, Zuxin Liu, Shirley Kokane, Akshara Prabhakar 외 arxiv

Modern LLM deployments confront a widening cost-performance spectrum: premium models deliver strong reasoning but are expensive, while lightweight models are economical yet brittle on complex tasks. Static escalation rul…

Reinforcement Learning

ProxRouter: Proximity-Weighted LLM Query Routing for Improved Robustness to Outliers

2025-10-10 · Shivam Patel, Neharika Jali, Ankur Mallick, Gauri Joshi arxiv

Large language model (LLM) query routers are critical to modern AI platforms as they seek to improve efficiency by assigning inference queries to accurate, yet low-cost models. Parametric routers typically use trained ne…

LLMRouter: Unified Infrastructure for Developing, Evaluating, and Deploying LLM Routers

2026-08-07 · Tao Feng, Fangxu Yu, Haozhen Zhang, Zhongjie Dai 외 hf

No single large language model (LLM) is optimal across all queries and budget constraints, making model routing essential for cost-effective deployment. Existing routers adopt diverse formulations and implementations, ma…

Multi-Agent Path Planning Using Deep Reinforcement Learning

2021-10-04 · Mert Çetinkaya

In this paper a deep reinforcement based multi-agent path planning approach is introduced. The experiments are realized in a simulation environment and in this environment different multi-agent path planning problems are…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Value-Decomposed Reinforcement Learning Framework for Taxiway Routing with Hierarchical Conflict-Aware Observations

2026-05-09 · Shizhong Zhou, Haifeng Liu, Zheng Zhang, Shiyu Zhang 외 arxiv

Taxiway routing and on-surface conflict avoidance are coupled safety-critical decision problems in airport surface operations. Existing planning and optimization methods are often limited by online computational cost, wh…