Real-Time Bidding with Side Information

2017-12-01 · NeurIPS 2017 12 · Arthur Flajolet, Patrick Jaillet

We consider the problem of repeated bidding in online advertising auctions when some side information (e.g. browser cookies) is available ahead of submitting a bid in the form of a $d$-dimensional vector. The goal for the advertiser is to maximize the total utility (e.g. the total number of clicks) derived from displaying ads given that a limited budget $B$ is allocated for a given time horizon $T$. Optimizing the bids is modeled as a contextual Multi-Armed Bandit (MAB) problem with a knapsack constraint and a continuum of arms. We develop UCB-type algorithms that combine two streams of literature: the confidence-set approach to linear contextual MABs and the probabilistic bisection search method for stochastic root-finding. Under mild assumptions on the underlying unknown distribution, we establish distribution-independent regret bounds of order $\tilde{O}(d \cdot \sqrt{T})$ when either $B = \infty$ or when $B$ scales linearly with $T$.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Real-Time Bidding by Reinforcement Learning in Display Advertising

2017-01-10 · Han Cai, Kan Ren, Wei-Nan Zhang, Kleanthis Malialis 외

The majority of online display ads are served through real-time bidding (RTB) --- each ad display impression is auctioned off in real-time when it is just being generated from a user visit. To place an ad automatically a…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Functional Optimization Reinforcement Learning for Real-Time Bidding

2022-06-25 · Yining Lu, Changjie Lu, Naina Bandyopadhyay, Manoj Kumar 외

Real-time bidding is the new paradigm of programmatic advertising. An advertiser wants to make the intelligent choice of utilizing a \textbf{Demand-Side Platform} to improve the performance of their ad campaigns. Existin…

Attribute Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

A Real-World Implementation of Unbiased Lift-based Bidding System

2022-02-23 · Daisuke Moriwaki, Yuta Hayakawa, Akira Matsui, Yuta Saito 외

In display ad auctions of Real-Time Bid-ding (RTB), a typical Demand-Side Platform (DSP)bids based on the predicted probability of click and conversion right after an ad impression. Recent studies find such a strategy is…

Real-time Bidding Strategy in Display Advertising: An Empirical Analysis

2022-11-30 · Mengjuan Liu, Zhengning Hu, Zhi Lai, Daiwei Zheng 외

Bidding strategies that help advertisers determine bidding prices are receiving increasing attention as more and more ad impressions are sold through real-time bidding systems. This paper first describes the problem and …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

MoTiAC: Multi-Objective Actor-Critics for Real-Time Bidding

2020-02-18 · Haolin Zhou, Chaoqi Yang, Xiaofeng Gao, Qiong Chen 외

Online Real-Time Bidding (RTB) is a complex auction game among which advertisers struggle to bid for ad impressions when a user request occurs. Considering display cost, Return on Investment (ROI), and other influential …

Reinforcement Learning Reinforcement Learning (RL)