Integrating process design and control using reinforcement learning
To create efficient-high performing processes, one must find an optimal design with its corresponding controller that ensures optimal operation in the presence of uncertainty. When comparing different process designs, for the comparison to be meaningful, each design must involve its optimal operation. Therefore, to optimize a process' design, one must address design and control simultaneously. For this, one can formulate a bilevel optimization problem, with the design as the outer problem in the form of a mixed-integer nonlinear program (MINLP) and a stochastic optimal control as the inner problem. This is intractable by most approaches. In this paper we propose to compute the optimal control using reinforcement learning, and then embed this controller into the design problem. This allows to decouple the solution procedure, while having the same optimal result as if solving the bilevel problem. The approach is tested in two case studies and the performance of the controller is evaluated. The case studies indicate that the proposed approach outperforms current state-of-the-art simultaneous design and control strategies. This opens a new avenue to address simultaneous design and control of engineering systems.
Code (0)
등록된 구현이 없습니다.
Tasks
Bilevel Optimizationreinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Digital Twin-based Control Co-Design of Full Vehicle Active Suspensions via Deep Reinforcement Learning
Active suspension systems are critical for enhancing vehicle comfort, safety, and stability, yet their performance is often limited by fixed hardware designs and control strategies that cannot adapt to uncertain and dyna…
Reinforcement LearningChasing Stability: Humanoid Running via Control Lyapunov Function Guided Reinforcement Learning
Achieving highly dynamic behaviors on humanoid robots, such as running, requires controllers that are both robust and precise, and hence difficult to design. Classical control methods offer valuable insight into how such…
Reinforcement LearningImproving Image Captioning with Control Signal of Sentence Quality
In the dataset of image captioning, each image is aligned with several descriptions. Despite the fact that the quality of these descriptions varies, existing captioning models treat them equally in the training process. …
Image CaptioningSentenceTemporal Logic Guided Safe Reinforcement Learning Using Control Barrier Functions
Using reinforcement learning to learn control policies is a challenge when the task is complex with potentially long horizons. Ensuring adequate but safe exploration is also crucial for controlling physical systems. In t…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Safe Exploration+1Neural Operator based Reinforcement Learning for Control of first-order PDEs with Spatially-Varying State Delay
Control of distributed parameter systems affected by delays is a challenging task, particularly when the delays depend on spatial variables. The idea of integrating analytical control theory with learning-based control w…
Deep Reinforcement LearningReinforcement Learning (RL)