Placement Optimization with Deep Reinforcement Learning

2020-03-18 · Anna Goldie, Azalia Mirhoseini

Placement Optimization is an important problem in systems and chip design, which consists of mapping the nodes of a graph onto a limited set of resources to optimize for an objective, subject to constraints. In this paper, we start by motivating reinforcement learning as a solution to the placement problem. We then give an overview of what deep reinforcement learning is. We next formulate the placement problem as a reinforcement learning problem and show how this problem can be solved with policy gradient optimization. Finally, we describe lessons we have learned from training deep reinforcement learning policies across a variety of placement optimization problems.

📄 PDF Abstract BibTeX arXiv:2003.08445

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Guiding Global Placement With Reinforcement Learning

2021-09-06 · Robert Kirby, Kolby Nottingham, Rajarshi Roy, Saad Godil 외

Recent advances in GPU accelerated global and detail placement have reduced the time to solution by an order of magnitude. This advancement allows us to leverage data driven optimization (such as Reinforcement Learning) …

GPU reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Controlled Deep Reinforcement Learning for Optimized Slice Placement

2021-08-03 · Jose Jurandir Alves Esteves, Amina Boubendir, Fabrice Guillemin, Pierre Sens

We present a hybrid ML-heuristic approach that we name "Heuristically Assisted Deep Reinforcement Learning (HA-DRL)" to solve the problem of Network Slice Placement Optimization. The proposed approach leverages recent wo…

Deep Reinforcement Learning Network Embedding reinforcement-learning Reinforcement Learning+1

Non-Overlapping Placement of Macro Cells based on Reinforcement Learning in Chip Design

2024-07-26 · Tao Yu, Peng Gao, Fei Wang, Ru-Yue Yuan

Due to the increasing complexity of chip design, existing placement methods still have many shortcomings in dealing with macro cells coverage and optimization efficiency. Aiming at the problems of layout overlap, inferio…

RL4health: Crowdsourcing Reinforcement Learning for Knee Replacement Pathway Optimization

2019-05-24 · Hao Lu, Mengdi Wang

Joint replacement is the most common inpatient surgical treatment in the US. We investigate the clinical pathway optimization for knee replacement, which is a sequential decision process from onset to recovery. Based on …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

On Joint Learning for Solving Placement and Routing in Chip Design

2021-10-30 · NeurIPS 2021 12 · Ruoyu Cheng, Junchi Yan

For its advantage in GPU acceleration and less dependency on human experts, machine learning has been an emerging tool for solving the placement and routing problems, as two critical steps in modern chip design flow. Bei…