Distributed Multi-Agent Deep Reinforcement Learning Framework for Whole-building HVAC Control

2021-10-26 · Vinay Hanumaiah, Sahika Genc

It is estimated that about 40%-50% of total electricity consumption in commercial buildings can be attributed to Heating, Ventilation, and Air Conditioning (HVAC) systems. Minimizing the energy cost while considering the thermal comfort of the occupants is very challenging due to unknown and complex relationships between various HVAC controls and thermal dynamics inside a building. To this end, we present a multi-agent, distributed deep reinforcement learning (DRL) framework based on Energy Plus simulation environment for optimizing HVAC in commercial buildings. This framework learns the complex thermal dynamics in the building and takes advantage of the differential effect of cooling and heating systems in the building to reduce energy costs, while maintaining the thermal comfort of the occupants. With adaptive penalty, the RL algorithm can be prioritized for energy savings or maintaining thermal comfort. Using DRL, we achieve more than 75\% savings in energy consumption. The distributed DRL framework can be scaled to multiple GPUs and CPUs of heterogeneous types.

📄 PDF Abstract BibTeX arXiv:2110.13450

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning (RL)

Diff-DAC: Distributed Actor-Critic for Average Multitask Deep Reinforcement Learning

2017-10-28 · Sergio Valcarcel Macua, Aleksi Tukiainen, Daniel García-Ocaña Hernández, David Baldazo 외

We propose a fully distributed actor-critic algorithm approximated by deep neural networks, named \textit{Diff-DAC}, with application to single-task and to average multitask reinforcement learning (MRL). Each agent has a…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Distributed Voltage Regulation of Active Distribution System Based on Enhanced Multi-agent Deep Reinforcement Learning

2020-05-31 · Di Cao, Junbo Zhao, Weihao Hu, Fei Ding 외

This paper proposes a data-driven distributed voltage control approach based on the spectrum clustering and the enhanced multi-agent deep reinforcement learning (MADRL) algorithm. Via the unsupervised clustering, the who…

Clustering Deep Reinforcement Learning

Fully Distributed Actor-Critic Architecture for Multitask Deep Reinforcement Learning

2021-10-23 · Sergio Valcarcel Macua, Ian Davies, Aleksi Tukiainen, Enrique Munoz de Cote

We propose a fully distributed actor-critic architecture, named Diff-DAC, with application to multitask reinforcement learning (MRL). During the learning process, agents communicate their value and policy parameters to t…

continuous-control Continuous Control Deep Reinforcement Learning reinforcement-learning+2

Combating Uncertainties in Wind and Distributed PV Energy Sources Using Integrated Reinforcement Learning and Time-Series Forecasting

2023-02-27 · Arman Ghasemi, Amin Shojaeighadikolaei, Morteza Hashemi

Renewable energy sources, such as wind and solar power, are increasingly being integrated into smart grid systems. However, when compared to traditional energy resources, the unpredictability of renewable energy generati…

Decision Making energy management Management Multi-agent Reinforcement Learning+3

Efficient Distributed Framework for Collaborative Multi-Agent Reinforcement Learning

2022-05-11 · Shuhan Qi, Shuhao Zhang, Xiaohan Hou, Jiajia Zhang 외

Multi-agent reinforcement learning for incomplete information environments has attracted extensive attention from researchers. However, due to the slow sample collection and poor sample exploration, there are still some …

Diversity Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+3