paper-with-me

홈 › Papers

DRIVE: Distributional and Retrieval-Augmented Bidding with Value Evaluation

2026-06-12 · Miduo Cui, Haochen Wang, Shangqin Mao, Xun Yang, Qianlong Xie, Xingxing Wang, Xuri Ge, Ying Zhou, Zhiwei Xu arxiv

Auto-bidding is a core component of real-time advertising systems, where decisions must optimize long-term performance under budget and cost constraints, while online exploration is prohibitively risky. Offline reinforcement learning and, more recently, Transformer-based sequence modeling have shown promise for learning bidding policies from logged data, but their unimodal and purely parametric formulations often collapse multiple effective bidding strategies into suboptimal averaged actions and perform unreliably under sparse or long-tail traffic. To mitigate these limitations, we propose DRIVE (Distributional and Retrieval-Augmented Bidding with Value Evaluation), a unified Transformer-based framework that decouples candidate action generation from decision making for offline auto-bidding. DRIVE combines distributional action modeling, retrieval-augmented candidate generation from high-quality historical decisions, and value-based evaluation to select the most promising bid at inference time. Extensive experiments on AuctionNet and additional offline reinforcement learning benchmarks demonstrate that DRIVE consistently improves bidding performance and generalizes well across multiple Transformer-based methods.

📄 PDF Abstract BibTeX arXiv:2606.14192

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningDecision Making

Similar Papers 제목 키워드 기반

Learning-Augmented Online Bidding in Stochastic Settings

2025-10-29 · Spyros Angelopoulos, Bertrand Simon arxiv

Online bidding is a classic optimization problem, with several applications in online decision-making, the design of interruptible systems, and the analysis of approximation algorithms. In this work, we study online bidd…

Bidding-Aware Retrieval for Multi-Stage Consistency in Online Advertising

2025-08-07 · Bin Liu, Yunfei Liu, Ziru Xu, Zhaoyu Zhou 외 arxiv

Online advertising systems typically use a cascaded architecture to manage massive requests and candidate volumes, where the ranking stages allocate traffic based on eCPM (predicted CTR $\times$ Bid). With the increasing…

Adaptive Bidding Policies for First-Price Auctions with Budget Constraints under Non-stationarity

2025-05-05 · Yige Wang, Jiashuo Jiang

We study how a budget-constrained bidder should learn to adaptively bid in repeated first-price auctions to maximize her cumulative payoff. This problem arose due to an industry-wide shift from second-price auctions to f…

Optimizing Return Distributions with Distributional Dynamic Programming

2025-01-22 · Bernardo Ávila Pires, Mark Rowland, Diana Borsa, Zhaohan Daniel Guo 외

We introduce distributional dynamic programming (DP) methods for optimizing statistical functionals of the return distribution, with standard reinforcement learning as a special case. Previous distributional DP methods c…

Leveraging Bidding Graphs for Advertiser-Aware Relevance Modeling in Sponsored Search

2021-11-01 · Findings (EMNLP) 2021 11 · Shuxian Bi, Chaozhuo Li, Xiao Han, Zheng Liu 외

Recently, sponsored search has become one of the most lucrative channels for marketing. As the fundamental basis of sponsored search, relevance modeling has attracted increasing attention due to the tremendous practical …

Marketing