Networked Multiagent Safe Reinforcement Learning for Low-carbon Demand Management in Distribution Network

2023-11-27 · Jichen Zhang, Linwei Sang, Yinliang Xu, Hongbin Sun

This paper proposes a multiagent based bi-level operation framework for the low-carbon demand management in distribution networks considering the carbon emission allowance on the demand side. In the upper level, the aggregate load agents optimize the control signals for various types of loads to maximize the profits; in the lower level, the distribution network operator makes optimal dispatching decisions to minimize the operational costs and calculates the distribution locational marginal price and carbon intensity. The distributed flexible load agent has only incomplete information of the distribution network and cooperates with other agents using networked communication. Finally, the problem is formulated into a networked multi-agent constrained Markov decision process, which is solved using a safe reinforcement learning algorithm called consensus multi-agent constrained policy optimization considering the carbon emission allowance for each agent. Case studies with the IEEE 33-bus and 123-bus distribution network systems demonstrate the effectiveness of the proposed approach, in terms of satisfying the carbon emission constraint on demand side, ensuring the safe operation of the distribution network and preserving privacy of both sides.

📄 PDF Abstract BibTeX arXiv:2311.15594

Code (0)

등록된 구현이 없습니다.

Tasks

ManagementSafe Reinforcement Learning

Safe Multiagent Coordination via Entropic Exploration

2024-12-29 · Ayhan Alp Aydeniz, Enrico Marchesini, Robert Loftin, Christopher Amato 외

Many real-world multiagent learning problems involve safety concerns. In these setups, typical safe reinforcement learning algorithms constrain agents' behavior, limiting exploration -- a crucial component for discoverin…

reinforcement-learning Reinforcement Learning Safe Reinforcement Learning

On the dynamics of multi agent nonlinear filtering and learning

2023-09-07 · Sayed Pouria Talebi, Danilo Mandic

Multiagent systems aim to accomplish highly complex learning tasks through decentralised consensus seeking dynamics and their use has garnered a great deal of attention in the signal processing and computational intellig…

Federated Learning

Peer-to-Peer Energy Trading of Solar and Energy Storage: A Networked Multiagent Reinforcement Learning Approach

2024-01-25 · Chen Feng, Andrew L. Liu

Utilizing distributed renewable and energy storage resources in local distribution networks via peer-to-peer (P2P) energy trading has long been touted as a solution to improve energy systems' resilience and sustainabilit…

energy trading Management Multi-agent Reinforcement Learning reinforcement-learning+1

Resolving Congestions in the Air Traffic Management Domain via Multiagent Reinforcement Learning Methods

2019-12-14 · Theocharis Kravaris, Christos Spatharis, Alevizos Bastas, George A. Vouros 외

In this article, we report on the efficiency and effectiveness of multiagent reinforcement learning methods (MARL) for the computation of flight delays to resolve congestion problems in the Air Traffic Management (ATM) d…

Management reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Survey and Critique of Multiagent Deep Reinforcement Learning

2018-10-12 · Pablo Hernandez-Leal, Bilal Kartal, Matthew E. Taylor

Deep reinforcement learning (RL) has achieved outstanding results in recent years. This has led to a dramatic increase in the number of applications and methods. Recent works have explored learning beyond single-agent sc…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1