paper-with-me

홈 › Papers

Grid-Interactive Multi-Zone Building Control Using Reinforcement Learning with Global-Local Policy Search

2020-10-13

In this paper, we develop a grid-interactive multi-zone building controller based on a deep reinforcement learning (RL) approach. The controller is designed to facilitate building operation during normal conditions and demand response events, while ensuring occupants comfort and energy efficiency. We leverage a continuous action space RL formulation, and devise a two-stage global-local RL training framework. In the first stage, a global fast policy search is performed using a gradient-free RL algorithm. In the second stage, a local fine-tuning is conducted using a policy gradient method. In contrast to the state-of-the-art model predictive control (MPC) approach, the proposed RL controller does not require complex computation during real-time operation and can adapt to non-linear building models. We illustrate the controller performance numerically using a five-zone commercial building.

📄 PDF Abstract BibTeX arXiv:2010.06718

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningModel Predictive ControlReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Occupancy-Driven Stochastic Decision Framework for Ranking Commercial Building Loads

2021-03-21 · Milan Jain, Soumya Kundu, Arnab Bhattacharya, Sen Huang 외

For effective integration of building operations into the evolving demand response programs of the power grid, real-time decisions concerning the use of building appliances for grid services must excel on multiple criter…

From Model-Based to Model-Free: Learning Building Control for Demand Response

2022-10-18 · David Biagioni, Xiangyu Zhang, Christiane Adcock, Michael Sinner 외

Grid-interactive building control is a challenging and important problem for reducing carbon emissions, increasing energy efficiency, and supporting the electric power grid. Currently researchers and practitioners are co…

model

Nonlinear Moving Horizon Estimation and Model Predictive Control for Buildings with Unknown HVAC Dynamics

2022-11-18 · Saman Mostafavi, Harish Doddi, Krishna Kalyanam, David Schwartz

We present a solution for modeling and online identification for heating, ventilation, and air conditioning (HVAC) control in buildings. Our approach comprises: (a) a resistance-capacitance (RC) model based on first orde…

ManagementModel Predictive ControlState Estimation

Empirical Exploration of Zone-by-zone Energy Flexibility: a Non-intrusive Load Disaggregation Approach for Commercial Buildings

2023-04-25 · Maomao Hu, Ram Rajagopal, Jacques A. de Chalendar

Building energy flexibility has been increasingly demonstrated as a cost-effective solution to respond to the needs of energy networks, including electric grids and district cooling and heating systems, improving the int…

A Distributed ADMM-based Deep Learning Approach for Thermal Control in Multi-Zone Buildings under Demand Response Events

2023-12-08 · Vincent Taboga, Hanane Dagdougui

The increasing electricity use and reliance on intermittent renewable energy sources challenge power grid management during peak demand, making Demand Response programs and energy conservation measures essential. This re…

Distributed OptimizationManagement