Safe multi-agent deep reinforcement learning for joint bidding and maintenance scheduling of generation units

2021-12-20 · Pegah Rokhforoz, Olga Fink

This paper proposes a safe reinforcement learning algorithm for generation bidding decisions and unit maintenance scheduling in a competitive electricity market environment. In this problem, each unit aims to find a bidding strategy that maximizes its revenue while concurrently retaining its reliability by scheduling preventive maintenance. The maintenance scheduling provides some safety constraints which should be satisfied at all times. Satisfying the critical safety and reliability constraints while the generation units have an incomplete information of each others' bidding strategy is a challenging problem. Bi-level optimization and reinforcement learning are state of the art approaches for solving this type of problems. However, neither bi-level optimization nor reinforcement learning can handle the challenges of incomplete information and critical safety constraints. To tackle these challenges, we propose the safe deep deterministic policy gradient reinforcement learning algorithm which is based on a combination of reinforcement learning and a predicted safety filter. The case study demonstrates that the proposed approach can achieve a higher profit compared to other state of the art methods while concurrently satisfying the system safety constraints.

📄 PDF Abstract BibTeX arXiv:2112.10459

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Reinforcement LearningScheduling

Safe Reinforcement Learning for Strategic Bidding of Virtual Power Plants in Day-Ahead Markets

2023-07-11 · Ognjen Stanojev, Lesia Mitridati, Riccardo de Nardis di Prata, Gabriela Hug

This paper presents a novel safe reinforcement learning algorithm for strategic bidding of Virtual Power Plants (VPPs) in day-ahead electricity markets. The proposed algorithm utilizes the Deep Deterministic Policy Gradi…

Safe Reinforcement Learning

Real-Time Bidding with Multi-Agent Reinforcement Learning in Display Advertising

2018-02-27 · Junqi Jin, Chengru Song, Han Li, Kun Gai 외

Real-time advertising allows advertisers to bid for each impression for a visiting user. To optimize specific goals such as maximizing revenue and return on investment (ROI) led by ad placements, advertisers not only nee…

Clustering Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Trajectory-wise Iterative Reinforcement Learning Framework for Auto-bidding

2024-02-23 · Haoming Li, Yusen Huo, Shuai Dou, Zhenzhe Zheng 외

In online advertising, advertisers participate in ad auctions to acquire ad opportunities, often by utilizing auto-bidding tools provided by demand-side platforms (DSPs). The current auto-bidding algorithms typically emp…

Offline RL reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Functional Optimization Reinforcement Learning for Real-Time Bidding

2022-06-25 · Yining Lu, Changjie Lu, Naina Bandyopadhyay, Manoj Kumar 외

Real-time bidding is the new paradigm of programmatic advertising. An advertiser wants to make the intelligent choice of utilizing a \textbf{Demand-Side Platform} to improve the performance of their ad campaigns. Existin…

Attribute Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Generative Auto-Bidding with Unified Modeling and Exploration

2026-05-19 · Mingming Zhang, Feiqing Zhuang, Na Li, Shengjie Sun 외 arxiv

Automated bidding is central to modern digital advertising. Early rule-based methods lacked adaptability, while subsequent Reinforcement Learning approaches modeled bidding as a Markov Decision Process but struggled with…

Reinforcement Learning