An Analysis of Multi-Agent Reinforcement Learning for Decentralized Inventory Control Systems

2023-07-21 · Marwan Mousa, Damien van de Berg, Niki Kotecha, Ehecatl Antonio del Rio-Chanona, Max Mowbray

Most solutions to the inventory management problem assume a centralization of information that is incompatible with organisational constraints in real supply chain networks. The inventory management problem is a well-known planning problem in operations research, concerned with finding the optimal re-order policy for nodes in a supply chain. While many centralized solutions to the problem exist, they are not applicable to real-world supply chains made up of independent entities. The problem can however be naturally decomposed into sub-problems, each associated with an independent entity, turning it into a multi-agent system. Therefore, a decentralized data-driven solution to inventory management problems using multi-agent reinforcement learning is proposed where each entity is controlled by an agent. Three multi-agent variations of the proximal policy optimization algorithm are investigated through simulations of different supply chain networks and levels of uncertainty. The centralized training decentralized execution framework is deployed, which relies on offline centralization during simulation-based policy identification, but enables decentralization when the policies are deployed online to the real system. Results show that using multi-agent proximal policy optimization with a centralized critic leads to performance very close to that of a centralized data-driven solution and outperforms a distributed model-based solution in most cases while respecting the information constraints of the system.

📄 PDF Abstract BibTeX arXiv:2307.11432

Code (0)

등록된 구현이 없습니다.

Tasks

Management Multi-agent Reinforcement Learning reinforcement-learning

Multi-Agent Reinforcement Learning with Shared Resources for Inventory Management

2022-12-15 · Yuandong Ding, Mingxiao Feng, Guozi Liu, Wei Jiang 외

In this paper, we consider the inventory management (IM) problem where we need to make replenishment decisions for a large number of stock keeping units (SKUs) to balance their supply and demand. In our setting, the cons…

Management Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

A Versatile Multi-Agent Reinforcement Learning Benchmark for Inventory Management

2023-06-13 · Xianliang Yang, Zhihao Liu, Wei Jiang, Chuheng Zhang 외

Multi-agent reinforcement learning (MARL) models multiple agents that interact and learn within a shared environment. This paradigm is applicable to various industrial scenarios such as autonomous driving, quantitative t…

Autonomous Driving Management Multi-agent Reinforcement Learning reinforcement-learning+1

The Invisible Handshake: Persistent Overpricing by Adaptive Market Agents

2025-10-14 · Luigi Foscari, Emanuele Guidotti, Nicolò Cesa-Bianchi, Tatjana Chavdarova 외 arxiv

We study overpricing in a repeated game between two representative agents: a market maker, who controls market liquidity, and a market taker, who chooses trade quantities. Market prices evolve through the endogenous pric…

Reinforcement Learning for Market Making in a Multi-agent Dealer Market

2019-11-14 · Sumitra Ganesh, Nelson Vadori, Mengda Xu, Hua Zheng 외

Market makers play an important role in providing liquidity to markets by continuously quoting prices at which they are willing to buy and sell, and managing inventory risk. In this paper, we build a multi-agent simulati…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Finite-Sample Analysis For Decentralized Batch Multi-Agent Reinforcement Learning With Networked Agents

2018-12-06 · Kaiqing Zhang, Zhuoran Yang, Han Liu, Tong Zhang 외

Despite the increasing interest in multi-agent reinforcement learning (MARL) in multiple communities, understanding its theoretical foundation has long been recognized as a challenging problem. In this work, we address t…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)