paper-with-me

홈 › Papers

Optimal Management of Grid-Interactive Efficient Buildings via Safe Reinforcement Learning

2024-09-12 · Xiang Huo, Boming Liu, Jin Dong, Jianming Lian, Mingxi Liu

Reinforcement learning (RL)-based methods have achieved significant success in managing grid-interactive efficient buildings (GEBs). However, RL does not carry intrinsic guarantees of constraint satisfaction, which may lead to severe safety consequences. Besides, in GEB control applications, most existing safe RL approaches rely only on the regularisation parameters in neural networks or penalty of rewards, which often encounter challenges with parameter tuning and lead to catastrophic constraint violations. To provide enforced safety guarantees in controlling GEBs, this paper designs a physics-inspired safe RL method whose decision-making is enhanced through safe interaction with the environment. Different energy resources in GEBs are optimally managed to minimize energy costs and maximize customer comfort. The proposed approach can achieve strict constraint guarantees based on prior knowledge of a set of developed hard steady-state rules. Simulations on the optimal management of GEBs, including heating, ventilation, and air conditioning (HVAC), solar photovoltaics, and energy storage systems, demonstrate the effectiveness of the proposed approach.

📄 PDF Abstract BibTeX arXiv:2409.08132

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingManagementReinforcement Learning (RL)Safe Reinforcement Learning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Event-based EV Charging Scheduling in A Microgrid of Buildings

2022-01-06 · Qilong Huang, Li Yang, Chen Hou, Zhiyong Zeng 외

With the popularization of the electric vehicles (EVs), EV charging demand is becoming an important load in the building. Considering the mobility of EVs from building to building and their uncertain charging demand, it …

Scheduling

MERLIN: Multi-agent offline and transfer learning for occupant-centric energy flexible operation of grid-interactive communities using smart meter data and CityLearn

2022-12-31 · Kingsley Nweye, Siva Sankaranarayanan, Zoltan Nagy

The decarbonization of buildings presents new challenges for the reliability of the electrical grid as a result of the intermittency of renewable energy sources and increase in grid load brought about by end-use electrif…

Transfer Learning

Energy Management in Storage-Augmented, Grid-Connected Prosumer Buildings and Neighbourhoods Using a Modified Simulated Annealing Optimization

2015-03-28 · Rosemarie Velik, Pascal Nicolay

This article introduces a modified simulated annealing optimization approach for automatically determining optimal energy management strategies in grid-connected, storage-augmented, photovoltaics-supplied prosumer buildi…

Benchmarkingenergy managementManagement

Nonlinear Moving Horizon Estimation and Model Predictive Control for Buildings with Unknown HVAC Dynamics

2022-11-18 · Saman Mostafavi, Harish Doddi, Krishna Kalyanam, David Schwartz

We present a solution for modeling and online identification for heating, ventilation, and air conditioning (HVAC) control in buildings. Our approach comprises: (a) a resistance-capacitance (RC) model based on first orde…

ManagementModel Predictive ControlState Estimation

Sensor Attacks and Resilient Defense on HVAC Systems for Energy Market Signal Tracking

2023-10-24 · Guanyu Tian, Qun Zhou Sun, Yiyuan Qiao

The power flexibility from smart buildings makes them suitable candidates for providing grid services. The building automation system (BAS) that employs model predictive control (MPC) for grid services relies heavily on …

Model Predictive ControlStochastic Optimization