Exploring Deep Reinforcement Learning for Holistic Smart Building Control

2023-01-27 · Xianzhong Ding, Alberto Cerpa, Wan Du

In this paper, we take a holistic approach to deal with the tradeoffs between energy use and comfort in commercial buildings. We developed a system called OCTOPUS, which employs a novel deep reinforcement learning (DRL) framework that uses a data-driven approach to find the optimal control sequences of all building's subsystems, including HVAC, lighting, blind and window systems. The DRL architecture includes a novel reward function that allows the framework to explore the tradeoffs between energy use and users' comfort, while at the same time enabling the solution of the high-dimensional control problem due to the interactions of four different building subsystems. In order to cope with OCTOPUS's data training requirements, we argue that calibrated simulations that match the target building operational points are the vehicle to generate enough data to be able to train our DRL framework to find the control solution for the target building. In our work, we trained OCTOPUS with 10-year weather data and a building model that is implemented in the EnergyPlus building simulator, which was calibrated using data from a real production building. Through extensive simulations, we demonstrate that OCTOPUS can achieve 14.26% and 8.1% energy savings compared with the state-of-the-art rule-based method in a LEED Gold Certified building and the latest DRL-based method available in the literature respectively, while maintaining human comfort within a desired range.

📄 PDF Abstract BibTeX arXiv:2301.11510

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

GridLearn: Multiagent Reinforcement Learning for Grid-Aware Building Energy Management

2021-10-12 · Aisling Pigott, Constance Crozier, Kyri Baker, Zoltan Nagy

Increasing amounts of distributed generation in distribution networks can provide both challenges and opportunities for voltage regulation across the network. Intelligent control of smart inverters and other smart buildi…

energy management Management Multi-agent Reinforcement Learning reinforcement-learning+2

Data-driven control of micro-climate in buildings: an event-triggered reinforcement learning approach

2020-01-28 · Ashkan Haji Hosseinloo, Alexander Ryzhov, Aldo Bischi, Henni Ouerdane 외

Smart buildings have great potential for shaping an energy-efficient, sustainable, and more economic future for our planet as buildings account for approximately 40% of the global energy consumption. Future of the smart …

Decision Making Reinforcement Learning Reinforcement Learning (RL)

A Relearning Approach to Reinforcement Learning for Control of Smart Buildings

2020-08-04 · Avisek Naug, Marcos Quiñones-Grueiro, Gautam Biswas

This paper demonstrates that continual relearning of control policies using incremental deep reinforcement learning (RL) can improve policy learning for non-stationary processes. We demonstrate this approach for a data-d…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Energy-Efficient Thermal Comfort Control in Smart Buildings via Deep Reinforcement Learning

2019-01-15 · Guanyu Gao, Jie Li, Yonggang Wen

Heating, Ventilation, and Air Conditioning (HVAC) is extremely energy-consuming, accounting for 40% of total building energy consumption. Therefore, it is crucial to design some energy-efficient building thermal control …

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Centralised Soft Actor Critic Deep Reinforcement Learning Approach to District Demand Side Management through CityLearn

2020-09-22 · Anjukan Kathirgamanathan, Kacper Twardowski, Eleni Mangina, Donal Finn

Reinforcement learning is a promising model-free and adaptive controller for demand side management, as part of the future smart grid, at the district level. This paper presents the results of the algorithm that was subm…

Deep Reinforcement Learning Management reinforcement-learning Reinforcement Learning+1