MoTiAC: Multi-Objective Actor-Critics for Real-Time Bidding

2020-02-18 · Haolin Zhou, Chaoqi Yang, Xiaofeng Gao, Qiong Chen, Gongshen Liu, Guihai Chen

Online Real-Time Bidding (RTB) is a complex auction game among which advertisers struggle to bid for ad impressions when a user request occurs. Considering display cost, Return on Investment (ROI), and other influential Key Performance Indicators (KPIs), large ad platforms try to balance the trade-off among various goals in dynamics. To address the challenge, we propose a Multi-ObjecTive Actor-Critics algorithm based on reinforcement learning (RL), named MoTiAC, for the problem of bidding optimization with various goals. In MoTiAC, objective-specific agents update the global network asynchronously with different goals and perspectives, leading to a robust bidding policy. Unlike previous RL models, the proposed MoTiAC can simultaneously fulfill multi-objective tasks in complicated bidding environments. In addition, we mathematically prove that our model will converge to Pareto optimality. Finally, experiments on a large-scale real-world commercial dataset from Tencent verify the effectiveness of MoTiAC versus a set of recent approaches

📄 PDF Abstract BibTeX arXiv:2002.07408

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning Reinforcement Learning (RL)

Sim-Anchored Learning for On-the-Fly Adaptation

2023-01-17 · Bassel El Mabsout, Shahin Roozkhosh, Siddharth Mysore, Kate Saenko 외

Fine-tuning simulation-trained RL agents with real-world data often degrades crucial behaviors due to limited or skewed data distributions. We argue that designer priorities exist not just in reward functions, but also i…

Reinforcement Learning (RL)

Projected Natural Actor-Critic

2013-12-01 · NeurIPS 2013 12 · Philip S. Thomas, William C. Dabney, Stephen Giguere, Sridhar Mahadevan

Natural actor-critics are a popular class of policy search algorithms for finding locally optimal policies for Markov decision processes. In this paper we address a drawback of natural actor-critics that limits their rea…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

LLM Critics Help Catch LLM Bugs

2024-06-28 · Nat McAleese, Rai Michael Pokorny, Juan Felipe Ceron Uribe, Evgenia Nitishinskaya 외

Reinforcement learning from human feedback (RLHF) is fundamentally limited by the capacity of humans to correctly evaluate model output. To improve human evaluation ability and overcome that limitation this work trains "…

Multi Pseudo Q-learning Based Deterministic Policy Gradient for Tracking Control of Autonomous Underwater Vehicles

2019-09-07 · Wenjie Shi, Shiji Song, Cheng Wu, C. L. Philip Chen

This paper investigates trajectory tracking problem for a class of underactuated autonomous underwater vehicles (AUVs) with unknown dynamics and constrained inputs. Different from existing policy gradient methods which e…

Policy Gradient Methods Q-Learning

Value-Decomposition Multi-Agent Actor-Critics

2020-07-24 · Jianyu Su, Stephen Adams, Peter A. Beling

The exploitation of extra state information has been an active research area in multi-agent reinforcement learning (MARL). QMIX represents the joint action-value using a non-negative function approximator and achieves th…

Multi-agent Reinforcement Learning Reinforcement Learning (RL)Starcraft Starcraft II