paper-with-me

홈 › Papers

A Learning Based Framework for Handling Uncertain Lead Times in Multi-Product Inventory Management

2022-03-02 · Hardik Meisheri, Somjit Nath, Mayank Baranwal, Harshad Khadilkar

Most existing literature on supply chain and inventory management consider stochastic demand processes with zero or constant lead times. While it is true that in certain niche scenarios, uncertainty in lead times can be ignored, most real-world scenarios exhibit stochasticity in lead times. These random fluctuations can be caused due to uncertainty in arrival of raw materials at the manufacturer's end, delay in transportation, an unforeseen surge in demands, and switching to a different vendor, to name a few. Stochasticity in lead times is known to severely degrade the performance in an inventory management system, and it is only fair to abridge this gap in supply chain system through a principled approach. Motivated by the recently introduced delay-resolved deep Q-learning (DRDQN) algorithm, this paper develops a reinforcement learning based paradigm for handling uncertainty in lead times (\emph{action delay}). Through empirical evaluations, it is further shown that the inventory management with uncertain lead times is not only equivalent to that of delay in information sharing across multiple echelons (\emph{observation delay}), a model trained to handle one kind of delay is capable to handle delays of another kind without requiring to be retrained. Finally, we apply the delay-resolved framework to scenarios comprising of multiple products subjected to stochasticity in lead times, and elucidate how the delay-resolved framework negates the effect of any delay to achieve near-optimal performance.

📄 PDF Abstract BibTeX arXiv:2203.00885

Code (0)

등록된 구현이 없습니다.

Tasks

ManagementQ-Learning

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Similar Papers 제목 키워드 기반

Time-Discounting Convolution for Event Sequences with Ambiguous Timestamps

2018-12-06 · Takayuki Katsuki, Takayuki Osogami, Akira Koseki, Masaki Ono 외

This paper proposes a method for modeling event sequences with ambiguous timestamps, a time-discounting convolution. Unlike in ordinary time series, time intervals are not constant, small time-shifts have no significant …

Time SeriesTime Series Analysis

Quantifying Multimodality in World Models

2021-12-14 · Andreas Sedlmeier, Michael Kölle, Robert Müller, Leo Baudrexel 외

Model-based Deep Reinforcement Learning (RL) assumes the availability of a model of an environment's underlying transition dynamics. This model can be used to predict future effects of an agent's possible actions. When n…

Deep Reinforcement LearningReinforcement Learning (RL)

TimeSage-MT: A Multi-Turn Benchmark for Evaluating Agentic Time Series Reasoning

2026-05-31 · Yaxuan Kong, Qingren Yao, Yuqi Nie, Yichen Li 외 arxiv

Time series data inform critical decisions across many real-world domains. While large language model (LLM) agents can analyze data through natural language and tools, it remains unclear whether they can conduct reliable…

Time Series AnalysisAnomaly DetectionDecision Making

Clearing function-based release date optimization in a multi-item multi-stage MRP planned production system in a rolling-horizon planning environment with multilevel BOM

2025-02-24 · Wolfgang Seiringer, Klaus Altendorfer, Reha Uzsoy

This study explores the integration of clearing function (CF)-based release planning into Material Requirements Planning (MRP) systems, with a focus on mitigating the inherent rigidity of MRP in handling variability in p…

Scheduling

Multi-echelon Supply Chains with Uncertain Seasonal Demands and Lead Times Using Deep Reinforcement Learning

2022-01-12 · Julio César Alves, Geraldo Robson Mateus

We address the problem of production planning and distribution in multi-echelon supply chains. We consider uncertain demands and lead times which makes the problem stochastic and non-linear. A Markov Decision Process for…

Decision MakingDeep Reinforcement LearningReinforcement Learning (RL)Sequential Decision Making