The Challenges of Using Reinforcement Learning for Controlling Industrial Energy Systems
Reinforcement learning has shown promising results for optimizing the control of industrial energy systems, yet most existing studies remain limited to the application in simulation environments. We investigate the challenges of deploying reinforcement learning in a real-world industrial energy system, considering a thermal heating network as a use case. We formulate the task as a Markov Decision Process and systematically analyze the associated challenges along the structure of the formal description, including partial observability, action space design, reward design, and the simulation-to-reality gap. The challenges are grounded in an existing real-world deployment, where reinforcement learning achieves operational stability but shows a significant performance gap compared to simulation.
Code (0)
등록된 구현이 없습니다.
Tasks
Reinforcement LearningSimilar Papers 제목 키워드 기반
Controlling Commercial Cooling Systems Using Reinforcement Learning
This paper is a technical overview of DeepMind and Google's recent work on reinforcement learning for controlling commercial cooling systems. Building on expertise that began with cooling Google's data centers more effic…
Managementreinforcement-learningReinforcement LearningReinforcement Learning (RL)Controlling earthquake-like instabilities using artificial intelligence
Earthquakes are lethal and costly. This study aims at avoiding these catastrophic events by the application of injection policies retrieved through reinforcement learning. With the rapid growth of artificial intelligence…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Safeguarding Learning-based Control for Smart Energy Systems with Sampling Specifications
We study challenges using reinforcement learning in controlling energy systems, where apart from performance requirements, one has additional safety requirements such as avoiding blackouts. We detail how these safety req…
reinforcement-learningReinforcement LearningSafe Reinforcement LearningTrustworthy and Explainable Deep Reinforcement Learning for Safe and Energy-Efficient Process Control: A Use Case in Industrial Compressed Air Systems
This paper presents a trustworthy reinforcement learning approach for the control of industrial compressed air systems. We develop a framework that enables safe and energy-efficient operation under realistic boundary con…
Reinforcement LearningAn Energy-Saving Snake Locomotion Gait Policy Obtained Using Deep Reinforcement Learning
Snake robots, comprised of sequentially connected joint actuators, have recently gained increasing attention in the industrial field, like life detection in narrow space. Such robots can navigate through the complex envi…
Deep Reinforcement LearningNavigatereinforcement-learningReinforcement Learning (RL)