Towards Optimal District Heating Temperature Control in China with Deep Reinforcement Learning
Achieving efficiency gains in Chinese district heating networks, thereby reducing their carbon footprint, requires new optimal control methods going beyond current industry tools. Focusing on the secondary network, we propose a data-driven deep reinforcement learning (DRL) approach to address this task. We build a recurrent neural network, trained on simulated data, to predict the indoor temperatures. This model is then used to train two DRL agents, with or without expert guidance, for the optimal control of the supply water temperature. Our tests in a multi-apartment setting show that both agents can ensure a higher thermal comfort and at the same time a smaller energy cost, compared to an optimized baseline strategy.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement Learningreinforcement-learningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Decentralized temperature and storage volume control in multi-producer district heating
Modern district heating technologies have a great potential to make the energy sector more flexible and sustainable due to their capabilities to use energy sources of varied nature and to efficiently store energy for sub…
Using Flexibility Envelopes for the Demand-Side Hierarchical Optimization of District Heating Networks
The demand-side control of district heating networks is notoriously challenging due to the large number of connected users and the high number of states to be considered. To overcome these challenges, this paper presents…
Communication-Based Distributed Control of Large-Scale District Heating Networks
This paper presents a non-cooperative distributed model predictive controller for the control of large-scale District Heating Networks. To enable the design of this controller a novel information passing scheme and feasi…
Frequency Control and Power Sharing in Combined Heat and Power Networks
We consider the problem of using district heating systems as ancillary services for primary frequency control in power networks. We propose a novel power sharing scheme for heating systems based on the average temperatur…
Combating District Heating Bottlenecks Using Load Control
The 4th generation of district heating systems face a potential problem where lowered water temperatures lead to higher flow rates, which requires higher hydraulic capacity in terms of pipe and pump sizes. This increases…