Grid-Interactive Multi-Zone Building Control Using Reinforcement Learning with Global-Local Policy Search
In this paper, we develop a grid-interactive multi-zone building controller based on a deep reinforcement learning (RL) approach. The controller is designed to facilitate building operation during normal conditions and demand response events, while ensuring occupants comfort and energy efficiency. We leverage a continuous action space RL formulation, and devise a two-stage global-local RL training framework. In the first stage, a global fast policy search is performed using a gradient-free RL algorithm. In the second stage, a local fine-tuning is conducted using a policy gradient method. In contrast to the state-of-the-art model predictive control (MPC) approach, the proposed RL controller does not require complex computation during real-time operation and can adapt to non-linear building models. We illustrate the controller performance numerically using a five-zone commercial building.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningModel Predictive ControlReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Occupancy-Driven Stochastic Decision Framework for Ranking Commercial Building Loads
For effective integration of building operations into the evolving demand response programs of the power grid, real-time decisions concerning the use of building appliances for grid services must excel on multiple criter…
From Model-Based to Model-Free: Learning Building Control for Demand Response
Grid-interactive building control is a challenging and important problem for reducing carbon emissions, increasing energy efficiency, and supporting the electric power grid. Currently researchers and practitioners are co…
modelNonlinear Moving Horizon Estimation and Model Predictive Control for Buildings with Unknown HVAC Dynamics
We present a solution for modeling and online identification for heating, ventilation, and air conditioning (HVAC) control in buildings. Our approach comprises: (a) a resistance-capacitance (RC) model based on first orde…
ManagementModel Predictive ControlState EstimationEmpirical Exploration of Zone-by-zone Energy Flexibility: a Non-intrusive Load Disaggregation Approach for Commercial Buildings
Building energy flexibility has been increasingly demonstrated as a cost-effective solution to respond to the needs of energy networks, including electric grids and district cooling and heating systems, improving the int…
A Distributed ADMM-based Deep Learning Approach for Thermal Control in Multi-Zone Buildings under Demand Response Events
The increasing electricity use and reliance on intermittent renewable energy sources challenge power grid management during peak demand, making Demand Response programs and energy conservation measures essential. This re…
Distributed OptimizationManagement