A Learning Based Framework for Handling Uncertain Lead Times in Multi-Product Inventory Management
Most existing literature on supply chain and inventory management consider stochastic demand processes with zero or constant lead times. While it is true that in certain niche scenarios, uncertainty in lead times can be ignored, most real-world scenarios exhibit stochasticity in lead times. These random fluctuations can be caused due to uncertainty in arrival of raw materials at the manufacturer's end, delay in transportation, an unforeseen surge in demands, and switching to a different vendor, to name a few. Stochasticity in lead times is known to severely degrade the performance in an inventory management system, and it is only fair to abridge this gap in supply chain system through a principled approach. Motivated by the recently introduced delay-resolved deep Q-learning (DRDQN) algorithm, this paper develops a reinforcement learning based paradigm for handling uncertainty in lead times (\emph{action delay}). Through empirical evaluations, it is further shown that the inventory management with uncertain lead times is not only equivalent to that of delay in information sharing across multiple echelons (\emph{observation delay}), a model trained to handle one kind of delay is capable to handle delays of another kind without requiring to be retrained. Finally, we apply the delay-resolved framework to scenarios comprising of multiple products subjected to stochasticity in lead times, and elucidate how the delay-resolved framework negates the effect of any delay to achieve near-optimal performance.
Code (0)
등록된 구현이 없습니다.
Tasks
ManagementQ-LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Time-Discounting Convolution for Event Sequences with Ambiguous Timestamps
This paper proposes a method for modeling event sequences with ambiguous timestamps, a time-discounting convolution. Unlike in ordinary time series, time intervals are not constant, small time-shifts have no significant …
Time SeriesTime Series AnalysisQuantifying Multimodality in World Models
Model-based Deep Reinforcement Learning (RL) assumes the availability of a model of an environment's underlying transition dynamics. This model can be used to predict future effects of an agent's possible actions. When n…
Deep Reinforcement LearningReinforcement Learning (RL)TimeSage-MT: A Multi-Turn Benchmark for Evaluating Agentic Time Series Reasoning
Time series data inform critical decisions across many real-world domains. While large language model (LLM) agents can analyze data through natural language and tools, it remains unclear whether they can conduct reliable…
Time Series AnalysisAnomaly DetectionDecision MakingClearing function-based release date optimization in a multi-item multi-stage MRP planned production system in a rolling-horizon planning environment with multilevel BOM
This study explores the integration of clearing function (CF)-based release planning into Material Requirements Planning (MRP) systems, with a focus on mitigating the inherent rigidity of MRP in handling variability in p…
SchedulingMulti-echelon Supply Chains with Uncertain Seasonal Demands and Lead Times Using Deep Reinforcement Learning
We address the problem of production planning and distribution in multi-echelon supply chains. We consider uncertain demands and lead times which makes the problem stochastic and non-linear. A Markov Decision Process for…
Decision MakingDeep Reinforcement LearningReinforcement Learning (RL)Sequential Decision Making