Scalable Multi-Agent Reinforcement Learning for Residential Load Scheduling under Data Governance

2021-10-06 · Zhaoming Qin, Nanqing Dong, Di Liu, Zhefan Wang, Junwei Cao

As a data-driven approach, multi-agent reinforcement learning (MARL) has made remarkable advances in solving cooperative residential load scheduling problems. However, centralized training, the most common paradigm for MARL, limits large-scale deployment in communication-constrained cloud-edge environments. As a remedy, distributed training shows unparalleled advantages in real-world applications but still faces challenge with system scalability, e.g., the high cost of communication overhead during coordinating individual agents, and needs to comply with data governance in terms of privacy. In this work, we propose a novel MARL solution to address these two practical issues. Our proposed approach is based on actor-critic methods, where the global critic is a learned function of individual critics computed solely based on local observations of households. This scheme preserves household privacy completely and significantly reduces communication cost. Simulation experiments demonstrate that the proposed framework achieves comparable performance to the state-of-the-art actor-critic framework without data governance and communication constraints.

📄 PDF Abstract BibTeX arXiv:2110.02784

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement LearningPrivacy PreservingReinforcement Learning (RL)Scheduling

Scalable multi-agent reinforcement learning for distributed control of residential energy flexibility

2022-03-07 · Flora Charbonnier, Thomas Morstyn, Malcolm D. McCulloch

This paper proposes a novel scalable type of multi-agent reinforcement learning-based coordination for distributed residential energy. Cooperating agents learn to control the flexibility offered by electric vehicles, spa…

Multi-agent Reinforcement Learning Q-Learning reinforcement-learning Reinforcement Learning (RL)

Centralised rehearsal of decentralised cooperation: Multi-agent reinforcement learning for the scalable coordination of residential energy flexibility

2023-05-30 · Flora Charbonnier, Bei Peng, Thomas Morstyn, Malcolm McCulloch

This paper investigates how deep multi-agent reinforcement learning can enable the scalable and privacy-preserving coordination of residential energy flexibility. The coordination of distributed resources such as electri…

Multi-agent Reinforcement Learning Privacy Preserving reinforcement-learning Reinforcement Learning

Intelligent Residential Energy Management System using Deep Reinforcement Learning

2020-05-28 · Alwyn Mathew, Abhijit Roy, Jimson Mathew

The rising demand for electricity and its essential nature in today's world calls for intelligent home energy management (HEM) systems that can reduce energy usage. This involves scheduling of loads from peak hours of th…

Deep Reinforcement Learning energy management Management reinforcement-learning+3

Multi-Agent Reinforcement Learning for Fast-Timescale Demand Response of Residential Loads

2023-01-06 · Vincent Mai, Philippe Maisonneuve, Tianyu Zhang, Hadi Nekoei 외

To integrate high amounts of renewable energy resources, electrical power grids must be able to cope with high amplitude, fast timescale variations in power generation. Frequency regulation through demand response has th…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Pareto local search for a multi-objective demand response problem in residential areas with heat pumps and electric vehicles

2024-07-16 · Thomas Dengiz, Andrea Raith, Max Kleinebrahm, Jonathan Vogl 외

In future energy systems characterized by significant shares of fluctuating renewable energy sources, there is a need for a fundamental change in electricity consumption. The energy system requires the ability to adapt t…

Evolutionary Algorithms Heuristic Search reinforcement-learning Reinforcement Learning