Multi-Agent Reinforcement Learning with Shared Resource in Inventory Management

2021-09-29 · Mingxiao Feng, Guozi Liu, Li Zhao, Lei Song, Jiang Bian, Tao Qin, Wengang Zhou, Houqiang Li, Tie-Yan Liu

We consider inventory management (IM) problem for a single store with a large number of SKUs (stock keeping units) in this paper, where we need to make replenishment decisions for each SKU to balance its supply and demand. Each SKU should cooperate with each other to maximize profits, as well as compete for shared resources e.g., warehouse spaces, budget etc. Co-existence of cooperation and competition behaviors makes IM a complicate game, hence IM can be naturally modelled as a multi-agent reinforcement learning (MARL) problem. In IM problem, we find that agents only interact indirectly with each other through some shared resources, e.g., warehouse spaces. To formally model MARL problems with above structure, we propose shared resource stochastic game along with an efficient algorithm to learn policies particularly for a large number of agents. By leveraging shared-resource structure, our method can greatly reduce model complexity and accelerate learning procedure compared with standard MARL algorithms, as shown by extensive experiments.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Management Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Multi-Agent Reinforcement Learning with Shared Resources for Inventory Management

2022-12-15 · Yuandong Ding, Mingxiao Feng, Guozi Liu, Wei Jiang 외

In this paper, we consider the inventory management (IM) problem where we need to make replenishment decisions for a large number of stock keeping units (SKUs) to balance their supply and demand. In our setting, the cons…

Management Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

A Versatile Multi-Agent Reinforcement Learning Benchmark for Inventory Management

2023-06-13 · Xianliang Yang, Zhihao Liu, Wei Jiang, Chuheng Zhang 외

Multi-agent reinforcement learning (MARL) models multiple agents that interact and learn within a shared environment. This paradigm is applicable to various industrial scenarios such as autonomous driving, quantitative t…

Autonomous Driving Management Multi-agent Reinforcement Learning reinforcement-learning+1

Cooperative Multi-Agent Reinforcement Learning for Inventory Management

2023-04-18 · Madhav Khirwar, Karthik S. Gurumoorthy, Ankit Ajit Jain, Shantala Manchenahally

With Reinforcement Learning (RL) for inventory management (IM) being a nascent field of research, approaches tend to be limited to simple, linear environments with implementations that are minor modifications of off-the-…

GPU Management Multi-agent Reinforcement Learning reinforcement-learning+2

Reinforcement Learning for Multi-Product Multi-Node Inventory Management in Supply Chains

2020-06-07 · Nazneen N Sultana, Hardik Meisheri, Vinita Baniwal, Somjit Nath 외

This paper describes the application of reinforcement learning (RL) to multi-product inventory management in supply chains. The problem description and solution are both adapted from a real-world business solution. The n…

Decision Making Hierarchical Reinforcement Learning Management reinforcement-learning+2

Reinforcement Learning for Market Making in a Multi-agent Dealer Market

2019-11-14 · Sumitra Ganesh, Nelson Vadori, Mengda Xu, Hua Zheng 외

Market makers play an important role in providing liquidity to markets by continuously quoting prices at which they are willing to buy and sell, and managing inventory risk. In this paper, we build a multi-agent simulati…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)