RTBAgent: A LLM-based Agent System for Real-Time Bidding

2025-02-02 · Leng Cai, Junxuan He, Yikai Li, Junjie Liang, Yuanping Lin, Ziming Quan, Yawen Zeng, Jin Xu

Real-Time Bidding (RTB) enables advertisers to place competitive bids on impression opportunities instantaneously, striving for cost-effectiveness in a highly competitive landscape. Although RTB has widely benefited from the utilization of technologies such as deep learning and reinforcement learning, the reliability of related methods often encounters challenges due to the discrepancies between online and offline environments and the rapid fluctuations of online bidding. To handle these challenges, RTBAgent is proposed as the first RTB agent system based on large language models (LLMs), which synchronizes real competitive advertising bidding environments and obtains bidding prices through an integrated decision-making process. Specifically, obtaining reasoning ability through LLMs, RTBAgent is further tailored to be more professional for RTB via involved auxiliary modules, i.e., click-through rate estimation model, expert strategy knowledge, and daily reflection. In addition, we propose a two-step decision-making process and multi-memory retrieval mechanism, which enables RTBAgent to review historical decisions and transaction records and subsequently make decisions more adaptive to market changes in real-time bidding. Empirical testing with real advertising datasets demonstrates that RTBAgent significantly enhances profitability. The RTBAgent code will be publicly accessible at: https://github.com/CaiLeng/RTBAgent.

📄 PDF Abstract BibTeX arXiv:2502.00792

Code (1)

caileng/rtbagent 공식 구현 pytorch

Tasks

Decision Making

Real-Time Bidding with Multi-Agent Reinforcement Learning in Display Advertising

2018-02-27 · Junqi Jin, Chengru Song, Han Li, Kun Gai 외

Real-time advertising allows advertisers to bid for each impression for a visiting user. To optimize specific goals such as maximizing revenue and return on investment (ROI) led by ad placements, advertisers not only nee…

Clustering Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Functional Optimization Reinforcement Learning for Real-Time Bidding

2022-06-25 · Yining Lu, Changjie Lu, Naina Bandyopadhyay, Manoj Kumar 외

Real-time bidding is the new paradigm of programmatic advertising. An advertiser wants to make the intelligent choice of utilizing a \textbf{Demand-Side Platform} to improve the performance of their ad campaigns. Existin…

Attribute Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

LADDER: A Human-Level Bidding Agent for Large-Scale Real-Time Online Auctions

2017-08-18 · Yu Wang, Jiayi Liu, Yuxiang Liu, Jun Hao 외

We present LADDER, the first deep reinforcement learning agent that can successfully learn control policies for large-scale real-world problems directly from raw inputs composed of high-level semantic information. The ag…

Deep Reinforcement Learning Reinforcement Learning

Hierarchical Multi-agent Meta-Reinforcement Learning for Cross-channel Bidding

2024-12-26 · Shenghong He, Chao Yu

Real-time bidding (RTB) plays a pivotal role in online advertising ecosystems. Advertisers employ strategic bidding to optimize their advertising impact while adhering to various financial constraints, such as the return…

global-optimization Meta Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning+1

Deep Reinforcement Learning for Sponsored Search Real-time Bidding

2018-03-01 · Jun Zhao, Guang Qiu, Ziyu Guan, Wei Zhao 외

Bidding optimization is one of the most critical problems in online advertising. Sponsored search (SS) auction, due to the randomness of user query behavior and platform nature, usually adopts keyword-level bidding strat…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)