Multi-zone HVAC Control with Model-Based Deep Reinforcement Learning

2023-02-01 · Xianzhong Ding, Alberto Cerpa, Wan Du

In this paper, we conduct a set of experiments to analyze the limitations of current MBRL-based HVAC control methods, in terms of model uncertainty and controller effectiveness. Using the lessons learned, we develop MB2C, a novel MBRL-based HVAC control system that can achieve high control performance with excellent sample efficiency. MB2C learns the building dynamics by employing an ensemble of environment-conditioned neural networks. It then applies a new control method, Model Predictive Path Integral (MPPI), for HVAC control. It produces candidate action sequences by using an importance sampling weighted algorithm that scales better to high state and action dimensions of multi-zone buildings. We evaluate MB2C using EnergyPlus simulations in a five-zone office building. The results show that MB2C can achieve 8.23% more energy savings compared to the state-of-the-art MBRL solution while maintaining similar thermal comfort. MB2C can reduce the training data set by an order of magnitude (10.52x) while achieving comparable performance to MFRL approaches.

📄 PDF Abstract BibTeX arXiv:2302.00725

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Laxity-Aware Scalable Reinforcement Learning for HVAC Control

2023-06-29 · Ruohong Liu, Yuxin Pan, Yize Chen

Demand flexibility plays a vital role in maintaining grid balance, reducing peak demand, and saving customers' energy bills. Given their highly shiftable load and significant contribution to a building's energy consumpti…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

HVAC-DPT: A Decision Pretrained Transformer for HVAC Control

2024-11-29 · Anaïs Berkes

Building operations consume approximately 40% of global energy, with Heating, Ventilation, and Air Conditioning (HVAC) systems responsible for up to 50% of this consumption. As HVAC energy demands are expected to rise, o…

In-Context Reinforcement Learning Reinforcement Learning (RL)

Multi-Agent Deep Reinforcement Learning for HVAC Control in Commercial Buildings

2020-06-25 · Liang Yu, Yi Sun, Zhanbo Xu, Chao Shen 외

In commercial buildings, about 40%-50% of the total electricity consumption is attributed to Heating, Ventilation, and Air Conditioning (HVAC) systems, which places an economic burden on building operators. In this paper…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

ThermoLLM: Thermodynamics-Aware HVAC Control with Spatial-Semantic Knowledge Graph

2026-06-22 · Kirtan Bhatt, Xiachong Lin, Matthew Amos, Flora D. Salim 외 arxiv

Multi-zone HVAC control is a spatial decision problem in which indoor thermal evolution and control decisions depend not only on outdoor conditions and internal heat gains but also on zone layout, physical adjacency, and…

A Safe and Data-efficient Model-based Reinforcement Learning System for HVAC Control

2024-07-16 · Xianzhong Ding, Zhiyu An, Arya Rathee, Wan Du

Model-Based Reinforcement Learning (MBRL) has been widely studied for Heating, Ventilation, and Air Conditioning (HVAC) control in buildings. One of the critical challenges is the large amount of data required to effecti…

Model-based Reinforcement Learning