Design Process is a Reinforcement Learning Problem

2022-11-06 · Reza kakooee, Benjamin Dillunberger

While reinforcement learning has been used widely in research during the past few years, it found fewer real-world applications than supervised learning due to some weaknesses that the RL algorithms suffer from, such as performance degradation in transitioning from the simulator to the real world. Here, we argue the design process is a reinforcement learning problem and can potentially be a proper application for RL algorithms as it is an offline process and conventionally is done in CAD software - a sort of simulator. This creates opportunities for using RL methods and, at the same time, raises challenges. While the design processes are so diverse, here we focus on the space layout planning (SLP), frame it as an RL problem under the Markov Decision Process, and use PPO to address the layout design problem. To do so, we developed an environment named RLDesigner, to simulate the SLP. The RLDesigner is an OpenAI Gym compatible environment that can be easily customized to define a diverse range of design scenarios. We publicly share the environment to encourage both RL and architecture communities to use it for testing different RL algorithms or in their design practice. The codes are available in the following GitHub repository https://github.com/ RezaKakooee/rldesigner/tree/Second_Paper

📄 PDF Abstract BibTeX arXiv:2211.03136

Code (1)

rezakakooee/rldesigner 공식 구현 pytorch

Tasks

Layout DesignOpenAI Gym reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Entropy Regularization 설명 없음

PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…

Deep reinforcement learning for process design: Review and perspective

2023-08-15 · Qinghe Gao, Artur M. Schweidtmann

The transformation towards renewable energy and feedstock supply in the chemical industry requires new conceptual process design approaches. Recently, breakthroughs in artificial intelligence offer opportunities to accel…

Decision Making Deep Reinforcement Learning reinforcement-learning Reinforcement Learning

Deep Reinforcement Learning for Process Synthesis

2020-09-23 · Laurence Illing Midgley

This paper demonstrates the application of reinforcement learning (RL) to process synthesis by presenting Distillation Gym, a set of RL environments in which an RL agent is tasked with designing a distillation train, giv…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Integrating process design and control using reinforcement learning

2021-08-11 · Steven Sachio, Max Mowbray, Maria Papathanasiou, Ehecatl Antonio del Rio-Chanona 외

To create efficient-high performing processes, one must find an optimal design with its corresponding controller that ensures optimal operation in the presence of uncertainty. When comparing different process designs, fo…

Bilevel Optimization reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

PCGRL: Procedural Content Generation via Reinforcement Learning

2020-01-24 · Ahmed Khalifa, Philip Bontrager, Sam Earle, Julian Togelius

We investigate how reinforcement learning can be used to train level-designing agents. This represents a new approach to procedural content generation in games, where level design is framed as a game, and the content gen…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Task-oriented Design through Deep Reinforcement Learning

2019-03-13 · Junyoung Choi, Minsung Hyun, Nojun Kwak

We propose a new low-cost machine-learning-based methodology which assists designers in reducing the gap between the problem and the solution in the design process. Our work applies reinforcement learning (RL) to find th…

BIG-bench Machine Learning Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1