MARL-iDR: Multi-Agent Reinforcement Learning for Incentive-based Residential Demand Response
This paper presents a decentralized Multi-Agent Reinforcement Learning (MARL) approach to an incentive-based Demand Response (DR) program, which aims to maintain the capacity limits of the electricity grid and prevent grid congestion by financially incentivizing residential consumers to reduce their energy consumption. The proposed approach addresses the key challenge of coordinating heterogeneous preferences and requirements from multiple participants while preserving their privacy and minimizing financial costs for the aggregator. The participant agents use a novel Disjunctively Constrained Knapsack Problem optimization to curtail or shift the requested household appliances based on the selected demand reduction. Through case studies with electricity data from $25$ households, the proposed approach effectively reduced energy consumption's Peak-to-Average ratio (PAR) by $14.48$% compared to the original PAR while fully preserving participant privacy. This approach has the potential to significantly improve the efficiency and reliability of the electricity grid, making it an important contribution to the management of renewable energy resources and the growing electricity demand.
Code (1)
Tasks
ManagementMulti-agent Reinforcement Learningreinforcement-learningSimilar Papers 제목 키워드 기반
Efficient Episodic Memory Utilization of Cooperative Multi-Agent Reinforcement Learning
In cooperative multi-agent reinforcement learning (MARL), agents aim to achieve a common goal, such as defeating enemies or scoring a goal. Existing MARL algorithms are effective but still require significant learning ti…
DecoderMulti-agent Reinforcement LearningQ-Learningreinforcement-learning+3Formal Contracts Mitigate Social Dilemmas in Multi-Agent RL
Multi-agent Reinforcement Learning (MARL) is a powerful tool for training autonomous agents acting independently in a common environment. However, it can lead to sub-optimal behavior when individual incentives and group …
ManagementMulti-agent Reinforcement LearningMulti-Objective Reinforcement Learningreinforcement-learningScalable Multi-Agent Reinforcement Learning for Residential Load Scheduling under Data Governance
As a data-driven approach, multi-agent reinforcement learning (MARL) has made remarkable advances in solving cooperative residential load scheduling problems. However, centralized training, the most common paradigm for M…
Multi-agent Reinforcement LearningPrivacy PreservingReinforcement Learning (RL)SchedulingBeyond Joint Demonstrations: Personalized Expert Guidance for Efficient Multi-Agent Reinforcement Learning
Multi-Agent Reinforcement Learning (MARL) algorithms face the challenge of efficient exploration due to the exponential increase in the size of the joint state-action space. While demonstration-guided learning has proven…
Efficient ExplorationMulti-agent Reinforcement LearningStarcraftRobust Multi-Agent Reinforcement Learning with Model Uncertainty
In this work, we study the problem of multi-agent reinforcement learning (MARL) with model uncertainty, which is referred to as robust MARL. This is naturally motivated by some multi-agent applications where each agent m…
modelMulti-agent Reinforcement LearningQ-Learningreinforcement-learning+2