DeepThermal: Combustion Optimization for Thermal Power Generating Units Using Offline Reinforcement Learning
Optimizing the combustion efficiency of a thermal power generating unit (TPGU) is a highly challenging and critical task in the energy industry. We develop a new data-driven AI system, namely DeepThermal, to optimize the combustion control strategy for TPGUs. At its core, is a new model-based offline reinforcement learning (RL) framework, called MORE, which leverages historical operational data of a TGPU to solve a highly complex constrained Markov decision process problem via purely offline training. In DeepThermal, we first learn a data-driven combustion process simulator from the offline dataset. The RL agent of MORE is then trained by combining real historical data as well as carefully filtered and processed simulation data through a novel restrictive exploration scheme. DeepThermal has been successfully deployed in four large coal-fired thermal power plants in China. Real-world experiments show that DeepThermal effectively improves the combustion efficiency of TPGUs. We also report the superior performance of MORE by comparing with the state-of-the-art algorithms on the standard offline RL benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
Continuous ControlOffline RLreinforcement-learningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Mean-value exergy modeling of internal combustion engines: characterization of feasible operating regions
In this paper, a novel mean-value exergy-based modeling framework for internal combustion engines is developed. The characterization of combustion irreversibilities, thermal exchange between the in-cylinder mixture and t…
Automated and Risk-Aware Engine Control Calibration Using Constrained Bayesian Optimization
Decarbonization of the transport sector sets increasingly strict demands to maximize thermal efficiency and minimize greenhouse gas emissions of Internal Combustion Engines. This has led to complex engines with a surge i…
Bayesian OptimizationSelf-LearningOnline Learning Models for Vehicle Usage Prediction During COVID-19
Today, there is an ongoing transition to more sustainable transportation, for which an essential part is the switch from combustion engine vehicles to battery electric vehicles (BEVs). BEVs have many advantages from a su…
PredictionDeepOHeat-v1: Efficient Operator Learning for Fast and Trustworthy Thermal Simulation and Optimization in 3D-IC Design
Thermal analysis is crucial in three-dimensional integrated circuit (3D-IC) design due to increased power density and complex heat dissipation paths. Although operator learning frameworks such as DeepOHeat have demonstra…
GPUKolmogorov-Arnold NetworksOperator learningData-driven Bi-level Optimization of Thermal Power Systems with embedded Artificial Neural Networks
Industrial thermal power systems have coupled performance variables with hierarchical order of importance, making their simultaneous optimization computationally challenging or infeasible. This barrier limits the integra…