Towards General Negotiation Strategies with End-to-End Reinforcement Learning

2024-06-21 · Bram M. Renting, Thomas M. Moerland, Holger H. Hoos, Catholijn M. Jonker

The research field of automated negotiation has a long history of designing agents that can negotiate with other agents. Such negotiation strategies are traditionally based on manual design and heuristics. More recently, reinforcement learning approaches have also been used to train agents to negotiate. However, negotiation problems are diverse, causing observation and action dimensions to change, which cannot be handled by default linear policy networks. Previous work on this topic has circumvented this issue either by fixing the negotiation problem, causing policies to be non-transferable between negotiation problems or by abstracting the observations and actions into fixed-size representations, causing loss of information and expressiveness due to feature design. We developed an end-to-end reinforcement learning method for diverse negotiation problems by representing observations and actions as a graph and applying graph neural networks in the policy. With empirical evaluations, we show that our method is effective and that we can learn to negotiate with other agents on never-before-seen negotiation problems. Our result opens up new opportunities for reinforcement learning in negotiation agents.

📄 PDF Abstract BibTeX arXiv:2406.15096

Code (1)

brenting/RL-negotiation 공식 구현

Tasks

reinforcement-learning Reinforcement Learning

Evaluating Persuasion Strategies and Deep Reinforcement Learning methods for Negotiation Dialogue agents

2017-04-01 · EACL 2017 4 · Simon Keizer, Markus Guhe, Heriberto Cuay{\'a}huitl, Ioannis Efstathiou 외

In this paper we present a comparative evaluation of various negotiation strategies within an online version of the game {``}Settlers of Catan{''}. The comparison is based on human subjects playing games against artifici…

Deep Reinforcement Learning Persuasion Strategies reinforcement-learning Reinforcement Learning+1

An Autonomous Negotiating Agent Framework with Reinforcement Learning Based Strategies and Adaptive Strategy Switching Mechanism

2021-02-06 · Ayan Sengupta, Yasser Mohammad, Shinji Nakadai

Despite abundant negotiation strategies in literature, the complexity of automated negotiation forbids a single strategy from being dominant against all others in different negotiation scenarios. To overcome this, one ap…

Mixture-of-Experts

A Deep Reinforcement Learning Approach to Concurrent Bilateral Negotiation

2020-01-31 · Pallavi Bagga, Nicola Paoletti, Bedour Alrayes, Kostas Stathis

We present a novel negotiation model that allows an agent to learn how to negotiate during concurrent bilateral negotiations in unknown and dynamic e-markets. The agent uses an actor-critic architecture with model-free r…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Fairness-Driven Method for Learning Human-Compatible Negotiation Strategies

2024-09-26 · Ryan Shea, Zhou Yu

Despite recent advancements in AI and NLP, negotiation remains a difficult domain for AI agents. Traditional game theoretic approaches that have worked well for two-player zero-sum games struggle in the context of negoti…

Fairness Language Modeling Language Modelling

EvoEmo: Towards Evolved Emotional Policies for Adversarial LLM Agents in Multi-Turn Price Negotiation

2025-09-04 · Yunbo Long, Liming Xu, Lukas Beckenbauer, Yuhan Liu 외 arxiv

Recent research on Chain-of-Thought (CoT) reasoning in Large Language Models (LLMs) has demonstrated that agents can engage in \textit{complex}, \textit{multi-turn} negotiations, opening new avenues for agentic AI. Howev…

Reinforcement Learning