Multi-Agent Reinforcement Learning for Fast-Timescale Demand Response of Residential Loads

2023-01-06 · Vincent Mai, Philippe Maisonneuve, Tianyu Zhang, Hadi Nekoei, Liam Paull, Antoine Lesage-Landry

To integrate high amounts of renewable energy resources, electrical power grids must be able to cope with high amplitude, fast timescale variations in power generation. Frequency regulation through demand response has the potential to coordinate temporally flexible loads, such as air conditioners, to counteract these variations. Existing approaches for discrete control with dynamic constraints struggle to provide satisfactory performance for fast timescale action selection with hundreds of agents. We propose a decentralized agent trained with multi-agent proximal policy optimization with localized communication. We explore two communication frameworks: hand-engineered, or learned through targeted multi-agent communication. The resulting policies perform well and robustly for frequency regulation, and scale seamlessly to arbitrary numbers of houses for constant processing times.

📄 PDF Abstract BibTeX arXiv:2301.02593

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Dual-Agent Deep Reinforcement Learning for Dynamic Pricing and Replenishment

2024-10-28 · Yi Zheng, Zehao Li, Peng Jiang, Yijie Peng

We study the dynamic pricing and replenishment problems under inconsistent decision frequencies. Different from the traditional demand assumption, the discreteness of demand and the parameter within the Poisson distribut…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning

Bi-level Off-policy Reinforcement Learning for Volt/VAR Control Involving Continuous and Discrete Devices

2021-04-13 · Haotian Liu, Wenchuan Wu

In Volt/Var control (VVC) of active distribution networks(ADNs), both slow timescale discrete devices (STDDs) and fast timescale continuous devices (FTCDs) are involved. The STDDs such as on-load tap changers (OLTC) and …

Reinforcement Learning (RL)

Multi-agent cooperation through in-context co-player inference

2026-02-18 · Marissa A. Weis, Maciej Wołczyk, Rajai Nasser, Rif A. Saurous 외 arxiv

Achieving cooperation among self-interested agents remains a fundamental challenge in multi-agent reinforcement learning. Recent work showed that mutual cooperation can be induced between "learning-aware" agents that acc…

Multi-agent Reinforcement Learning

Non-Stationary Policy Learning for Multi-Timescale Multi-Agent Reinforcement Learning

2023-07-17 · Patrick Emami, Xiangyu Zhang, David Biagioni, Ahmed S. Zamzam

In multi-timescale multi-agent reinforcement learning (MARL), agents interact across different timescales. In general, policies for time-dependent behaviors, such as those induced by multiple timescales, are non-stationa…

energy management Inductive Bias Management Multi-agent Reinforcement Learning+1

Independent and Decentralized Learning in Markov Potential Games

2022-05-29 · Chinmay Maheshwari, Manxi Wu, Druv Pai, Shankar Sastry

We study a multi-agent reinforcement learning dynamics, and analyze its asymptotic behavior in infinite-horizon discounted Markov potential games. We focus on the independent and decentralized setting, where players do n…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning