Demand-Side Scheduling Based on Multi-Agent Deep Actor-Critic Learning for Smart Grids

2020-05-05 · Joash Lee, Wenbo Wang, Dusit Niyato

We consider the problem of demand-side energy management, where each household is equipped with a smart meter that is able to schedule home appliances online. The goal is to minimize the overall cost under a real-time pricing scheme. While previous works have introduced centralized approaches in which the scheduling algorithm has full observability, we propose the formulation of a smart grid environment as a Markov game. Each household is a decentralized agent with partial observability, which allows scalability and privacy-preservation in a realistic setting. The grid operator produces a price signal that varies with the energy demand. We propose an extension to a multi-agent, deep actor-critic algorithm to address partial observability and the perceived non-stationarity of the environment from the agent's viewpoint. This algorithm learns a centralized critic that coordinates training of decentralized agents. Our approach thus uses centralized learning but decentralized execution. Simulation results show that our online deep reinforcement learning method can reduce both the peak-to-average ratio of total energy consumed and the cost of electricity for all households based purely on instantaneous observations and a price signal.

📄 PDF Abstract BibTeX arXiv:2005.01979

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningDistributional Reinforcement Learningenergy managementManagementSchedulingSmart Grid Prediction

Scalable Multi-agent Reinforcement Learning for Factory-wide Dynamic Scheduling

2024-09-20 · Jaeyeon Jang, Diego Klabjan, Han Liu, Nital S. Patel 외

Real-time dynamic scheduling is a crucial but notoriously challenging task in modern manufacturing processes due to its high decision complexity. Recently, reinforcement learning (RL) has been gaining attention as an imp…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Automated deep reinforcement learning for real-time scheduling strategy of multi-energy system integrated with post-carbon and direct-air carbon captured system

2023-01-18 · Tobi Michael Alabi, Nathan P. Lawrence, Lin Lu, Zaiyue Yang 외

The carbon-capturing process with the aid of CO2 removal technology (CDRT) has been recognised as an alternative and a prominent approach to deep decarbonisation. However, the main hindrance is the enormous energy demand…

Deep Reinforcement Learning Scheduling

VMAgent: Scheduling Simulator for Reinforcement Learning

2021-12-09 · Junjie Sheng, Shengliang Cai, Haochuan Cui, Wenhao Li 외

A novel simulator called VMAgent is introduced to help RL researchers better explore new methods, especially for virtual machine scheduling. VMAgent is inspired by practical virtual machine (VM) scheduling tasks and prov…

Cloud Computing reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Risk-Aware Energy Scheduling for Edge Computing with Microgrid: A Multi-Agent Deep Reinforcement Learning Approach

2020-02-21 · Md. Shirajum Munir, Sarder Fakhrul Abedin, Nguyen H. Tran, Zhu Han 외

In recent years, multi-access edge computing (MEC) is a key enabler for handling the massive expansion of Internet of Things (IoT) applications and services. However, energy consumption of a MEC network depends on volati…

Deep Reinforcement Learning Edge-computing Reinforcement Learning Scheduling

Agentic AI Home Energy Management System: A Large Language Model Framework for Residential Load Scheduling

2025-10-30 · Reda El Makroum, Sebastian Zwickl-Bernhard, Lukas Kranzl arxiv

The electricity sector transition requires substantial increases in residential demand response capacity, yet Home Energy Management Systems (HEMS) adoption remains limited by user interaction barriers requiring translat…

Prompt Engineering