Deep reinforcement learning for machine scheduling: Methodology, the state-of-the-art, and future directions
Machine scheduling aims to optimize job assignments to machines while adhering to manufacturing rules and job specifications. This optimization leads to reduced operational costs, improved customer demand fulfillment, and enhanced production efficiency. However, machine scheduling remains a challenging combinatorial problem due to its NP-hard nature. Deep Reinforcement Learning (DRL), a key component of artificial general intelligence, has shown promise in various domains like gaming and robotics. Researchers have explored applying DRL to machine scheduling problems since 1995. This paper offers a comprehensive review and comparison of DRL-based approaches, highlighting their methodology, applications, advantages, and limitations. It categorizes these approaches based on computational components: conventional neural networks, encoder-decoder architectures, graph neural networks, and metaheuristic algorithms. Our review concludes that DRL-based methods outperform exact solvers, heuristics, and tabular reinforcement learning algorithms in terms of computation speed and generating near-global optimal solutions. These DRL-based approaches have been successfully applied to static and dynamic scheduling across diverse machine environments and job characteristics. However, DRL-based schedulers face limitations in handling complex operational constraints, configurable multi-objective optimization, generalization, scalability, interpretability, and robustness. Addressing these challenges will be a crucial focus for future research in this field. This paper serves as a valuable resource for researchers to assess the current state of DRL-based machine scheduling and identify research gaps. It also aids experts and practitioners in selecting the appropriate DRL approach for production scheduling.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement Learningreinforcement-learningSchedulingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Machine Learning-Enhanced Aircraft Landing Scheduling under Uncertainties
This paper addresses aircraft delays, emphasizing their impact on safety and financial losses. To mitigate these issues, an innovative machine learning (ML)-enhanced landing scheduling methodology is proposed, aiming to …
SchedulingTraveling Salesman ProblemSafe Hierarchical Reinforcement Learning for CubeSat Task Scheduling Based on Energy Consumption
This paper presents a Hierarchical Reinforcement Learning methodology tailored for optimizing CubeSat task scheduling in Low Earth Orbits (LEO). Incorporating a high-level policy for global task distribution and a low-le…
Hierarchical Reinforcement Learningreinforcement-learningReinforcement LearningSchedulingImproving Sample Efficiency and Multi-Agent Communication in RL-based Train Rescheduling
We present preliminary results from our sixth placed entry to the Flatland international competition for train rescheduling, including two improvements for optimized reinforcement learning (RL) training efficiency, and t…
Policy Gradient Methodsreinforcement-learningReinforcement LearningReinforcement Learning (RL)An actor-critic algorithm with policy gradients to solve the job shop scheduling problem using deep double recurrent agents
There is a growing interest in integrating machine learning techniques and optimization to solve challenging optimization problems. In this work, we propose a deep reinforcement learning methodology for the job shop sche…
Deep Reinforcement LearningJob Shop Schedulingreinforcement-learningReinforcement Learning (RL)+1VMAgent: Scheduling Simulator for Reinforcement Learning
A novel simulator called VMAgent is introduced to help RL researchers better explore new methods, especially for virtual machine scheduling. VMAgent is inspired by practical virtual machine (VM) scheduling tasks and prov…
Cloud Computingreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1