Functional Optimization Reinforcement Learning for Real-Time Bidding

2022-06-25 · Yining Lu, Changjie Lu, Naina Bandyopadhyay, Manoj Kumar, Gaurav Gupta

Real-time bidding is the new paradigm of programmatic advertising. An advertiser wants to make the intelligent choice of utilizing a \textbf{Demand-Side Platform} to improve the performance of their ad campaigns. Existing approaches are struggling to provide a satisfactory solution for bidding optimization due to stochastic bidding behavior. In this paper, we proposed a multi-agent reinforcement learning architecture for RTB with functional optimization. We designed four agents bidding environment: three Lagrange-multiplier based functional optimization agents and one baseline agent (without any attribute of functional optimization) First, numerous attributes have been assigned to each agent, including biased or unbiased win probability, Lagrange multiplier, and click-through rate. In order to evaluate the proposed RTB strategy's performance, we demonstrate the results on ten sequential simulated auction campaigns. The results show that agents with functional actions and rewards had the most significant average winning rate and winning surplus, given biased and unbiased winning information respectively. The experimental evaluations show that our approach significantly improve the campaign's efficacy and profitability.

📄 PDF Abstract BibTeX arXiv:2206.13939

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeMulti-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Real-Time Bidding with Multi-Agent Reinforcement Learning in Display Advertising

2018-02-27 · Junqi Jin, Chengru Song, Han Li, Kun Gai 외

Real-time advertising allows advertisers to bid for each impression for a visiting user. To optimize specific goals such as maximizing revenue and return on investment (ROI) led by ad placements, advertisers not only nee…

Clustering Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Real-time Bidding Strategy in Display Advertising: An Empirical Analysis

2022-11-30 · Mengjuan Liu, Zhengning Hu, Zhi Lai, Daiwei Zheng 외

Bidding strategies that help advertisers determine bidding prices are receiving increasing attention as more and more ad impressions are sold through real-time bidding systems. This paper first describes the problem and …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Bid Optimization using Maximum Entropy Reinforcement Learning

2021-10-11 · Mengjuan Liu, Jinyu Liu, Zhengning Hu, Yuchen Ge 외

Real-time bidding (RTB) has become a critical way of online advertising. In RTB, an advertiser can participate in bidding ad impressions to display its advertisements. The advertiser determines every impression's bidding…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Hierarchical Multi-agent Meta-Reinforcement Learning for Cross-channel Bidding

2024-12-26 · Shenghong He, Chao Yu

Real-time bidding (RTB) plays a pivotal role in online advertising ecosystems. Advertisers employ strategic bidding to optimize their advertising impact while adhering to various financial constraints, such as the return…

global-optimization Meta Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning+1

Improving Real-Time Bidding in Online Advertising Using Markov Decision Processes and Machine Learning Techniques

2023-05-05 · Parikshit Sharma

Real-time bidding has emerged as an effective online advertising technique. With real-time bidding, advertisers can position ads per impression, enabling them to optimise ad campaigns by targeting specific audiences in r…

reinforcement-learning Reinforcement Learning