Scheduling Distributed Flexible Assembly Lines using Safe Reinforcement Learning with Soft Shielding
Highly automated assembly lines enable significant productivity gains in the manufacturing industry, particularly in mass production condition. Nonetheless, challenges persist in job scheduling for make-to-job and mass customization, necessitating further investigation to improve efficiency, reduce tardiness, promote safety and reliability. In this contribution, an advantage actor-critic based reinforcement learning method is proposed to address scheduling problems of distributed flexible assembly lines in a real-time manner. To enhance the performance, a more condensed environment representation approach is proposed, which is designed to work with the masks made by priority dispatching rules to generate fixed and advantageous action space. Moreover, a Monte-Carlo tree search based soft shielding component is developed to help address long-sequence dependent unsafe behaviors and monitor the risk of overdue scheduling. Finally, the proposed algorithm and its soft shielding component are validated in performance evaluation.
Code (0)
등록된 구현이 없습니다.
Tasks
Safe Reinforcement LearningSchedulingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Evolution of flexible industrial assembly
Assembly is a key industrial process to achieve finished goods. Driven by market demographics and technological advancements, industrial assembly has evolved through several phases i.e. craftmanship, bench assembly, asse…
SchedulingEvoDR: Evolving Dispatching Rules via Large Language Model for Dynamic Flexible Assembly Flow Shop Scheduling
Dynamic flexible assembly flow shop scheduling with multi-product delivery is a critical combinatorial problem, characterized by kitting supply and machine flexibility. Genetic programming is widely used to automatically…
Job Shop Scheduling Benchmark: Environments and Instances for Learning and Non-learning Methods
We introduce an open-source GitHub repository containing comprehensive benchmarks for a wide range of machine scheduling problems, including Job Shop Scheduling (JSP), Flow Shop Scheduling (FSP), Flexible Job Shop Schedu…
Job Shop SchedulingSchedulingA Sliding-Window-Based Reinforcement Learning for Dynamic Assembly Flow Shop Scheduling with Multi-Product Delivery
Multi-product kitting delivery imposes significant challenges for real-time scheduling in hybrid manufacturing systems that integrate processing and assembly, as dynamic order arrivals simultaneously alter supply depende…
Reinforcement LearningScheduling HVAC loads to promote renewable generation integration with a learning-based joint chance-constrained approach
The integration of distributed renewable generation (DRG) in distribution networks can be effectively promoted by scheduling flexible resources such as heating, ventilation, and air conditioning (HVAC) loads. However, fi…
Computational EfficiencyScheduling