LADDER: A Human-Level Bidding Agent for Large-Scale Real-Time Online Auctions

2017-08-18 · Yu Wang, Jiayi Liu, Yuxiang Liu, Jun Hao, Yang He, Jinghe Hu, Weipeng P. Yan, Mantian Li

We present LADDER, the first deep reinforcement learning agent that can successfully learn control policies for large-scale real-world problems directly from raw inputs composed of high-level semantic information. The agent is based on an asynchronous stochastic variant of DQN (Deep Q Network) named DASQN. The inputs of the agent are plain-text descriptions of states of a game of incomplete information, i.e. real-time large scale online auctions, and the rewards are auction profits of very large scale. We apply the agent to an essential portion of JD's online RTB (real-time bidding) advertising business and find that it easily beats the former state-of-the-art bidding policy that had been carefully engineered and calibrated by human experts: during JD.com's June 18th anniversary sale, the agent increased the company's ads revenue from the portion by more than 50%, while the advertisers' ROI (return on investment) also improved significantly.

📄 PDF Abstract BibTeX arXiv:1708.05565

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningReinforcement Learning

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

DQN A DQN, or Deep Q-Network, approximates a state-value function in a Q-Learning framework with a neural network. In the Atari…

A Cooperative-Competitive Multi-Agent Framework for Auto-bidding in Online Advertising

2021-06-11 · Chao Wen, Miao Xu, Zhilin Zhang, Zhenzhe Zheng 외

In online advertising, auto-bidding has become an essential tool for advertisers to optimize their preferred ad performance metrics by simply expressing high-level campaign objectives and constraints. Previous works desi…

Multi-agent Reinforcement Learning

Outbidding and Outbluffing Elite Humans: Mastering Liar's Poker via Self-Play and Reinforcement Learning

2025-11-05 · Richard Dewey, Janos Botyanszki, Ciamac C. Moallemi, Andrew T. Zheng arxiv

AI researchers have long focused on poker-like games as a testbed for environments characterized by multi-player dynamics, imperfect information, and reasoning under uncertainty. While recent breakthroughs have matched e…

Reinforcement Learning

Human-Agent Cooperation in Bridge Bidding

2020-11-28 · Edward Lockhart, Neil Burch, Nolan Bard, Sebastian Borgeaud 외

We introduce a human-compatible reinforcement-learning approach to a cooperative game, making use of a third-party hand-coded human-compatible bot to generate initial training data and to perform initial evaluation. Our …

Imitation Learning reinforcement-learning Reinforcement Learning (RL)

Real-Time Bidding with Multi-Agent Reinforcement Learning in Display Advertising

2018-02-27 · Junqi Jin, Chengru Song, Han Li, Kun Gai 외

Real-time advertising allows advertisers to bid for each impression for a visiting user. To optimize specific goals such as maximizing revenue and return on investment (ROI) led by ad placements, advertisers not only nee…

Clustering Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Ladder: A Model-Agnostic Framework Boosting LLM-based Machine Translation to the Next Level

2024-06-22 · Zhaopeng Feng, Ruizhe Chen, Yan Zhang, Zijie Meng 외

General-purpose Large Language Models (LLMs) like GPT-4 have achieved remarkable advancements in machine translation (MT) by leveraging extensive web content. On the other hand, translation-specific LLMs are built by pre…

Machine Translation Translation