Deep Controlled Learning for Inventory Control
Problem Definition: Are traditional deep reinforcement learning (DRL) algorithms, developed for a broad range of purposes including game-play and robotics, the most suitable machine learning algorithms for applications in inventory control? To what extent would DRL algorithms tailored to the unique characteristics of inventory control problems provide superior performance compared to DRL and traditional benchmarks? Methodology/results: We propose and study Deep Controlled Learning (DCL), a new DRL framework based on approximate policy iteration specifically designed to tackle inventory problems. Comparative evaluations reveal that DCL outperforms existing state-of-the-art heuristics in lost sales inventory control, perishable inventory systems, and inventory systems with random lead times, achieving lower average costs across all test instances and maintaining an optimality gap of no more than 0.1\%. Notably, the same hyperparameter set is utilized across all experiments, underscoring the robustness and generalizability of the proposed method. Managerial implications: These substantial performance and robustness improvements pave the way for the effective application of tailored DRL algorithms to inventory management problems, empowering decision-makers to optimize stock levels, minimize costs, and enhance responsiveness across various industries.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningManagementSimilar Papers 제목 키워드 기반
A central bank strategy for defending a currency peg
We consider a central bank strategy for maintaining a two-sided currency target zone, in which an exchange rate of two currencies is forced to stay between two thresholds. To keep the exchange rate from breaking the pres…
AI Agents for Inventory Control: Human-LLM-OR Complementarity
Inventory control is a fundamental operations problem in which ordering decisions are traditionally guided by theoretically grounded operations research (OR) algorithms. However, such algorithms often rely on rigid model…
An Analysis of Multi-Agent Reinforcement Learning for Decentralized Inventory Control Systems
Most solutions to the inventory management problem assume a centralization of information that is incompatible with organisational constraints in real supply chain networks. The inventory management problem is a well-kno…
ManagementMulti-agent Reinforcement Learningreinforcement-learningHigh-frequency market-making with inventory constraints and directional bets
In this paper we extend the market-making models with inventory constraints of Avellaneda and Stoikov ("High-frequency trading in a limit-order book", Quantitative Finance Vol.8 No.3 2008) and Gueant, Lehalle and Fernand…
Vocal Bursts Intensity PredictionControl of Dual-Sourcing Inventory Systems using Recurrent Neural Networks
A key challenge in inventory management is to identify policies that optimally replenish inventory from multiple suppliers. To solve such optimization problems, inventory managers need to decide what quantities to order …
CPUManagement