paper-with-me

홈 › Papers

A Sliding-Window-Based Reinforcement Learning for Dynamic Assembly Flow Shop Scheduling with Multi-Product Delivery

2026-07-03 · Junhao Qiu, Jianjun Liu, Ting Liu, Rongjie Liao, Zhantao Li, Qingfu Zhang arxiv

Multi-product kitting delivery imposes significant challenges for real-time scheduling in hybrid manufacturing systems that integrate processing and assembly, as dynamic order arrivals simultaneously alter supply dependencies and the set of feasible job-machine assignments. This paper proposes a sliding-window-based reinforcement learning (SWRL) framework for end-to-end online scheduling in the flexible assembly flow shop scheduling problem with complex kitting constraints. The problem is formulated as a heterogeneous graph-based Markov decision process that captures the dual-layer kitting structure and the tail-product bottleneck dynamics that produce a sparse reward landscape. To address the resulting challenges, SWRL integrates a sliding-window filtering mechanism that filters inactive nodes and prioritizes kitting-critical operations, a spatiotemporal graph encoding network that tracks bottleneck shifts across consecutive decision states, and a dynamic action mapping module with a constrained waiting strategy that adapts to the changing action space under variable topologies. Experiments on real-world instances from a home appliance manufacturer demonstrate that SWRL achieves consistent tardiness reductions over classical dispatching rules and existing deep reinforcement learning methods, and exhibits robust performance across varying resource configurations, order loads, and arrival concentrations.

📄 PDF Abstract BibTeX arXiv:2607.02941

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

Designing Adaptive Algorithms Based on Reinforcement Learning for Dynamic Optimization of Sliding Window Size in Multi-Dimensional Data Streams

2025-07-09 · Abolfazl Zarghani, Sadegh Abedi arxiv

Multi-dimensional data streams, prevalent in applications like IoT, financial markets, and real-time analytics, pose significant challenges due to their high velocity, unbounded nature, and complex inter-dimensional depe…

Computational EfficiencyReinforcement Learning

Sliding Selector Network with Dynamic Memory for Extractive Summarization of Long Documents

2021-06-01 · NAACL 2021 4 · Peng Cui, Le Hu

Neural-based summarization models suffer from the length limitation of text encoder. Long documents have to been truncated before they are sent to the model, which results in huge loss of summary-relevant contents. To ad…

Extractive Summarization

Incremental inference of collective graphical models

2020-06-26 · Rahul Singh, Isabel Haasler, Qinsheng Zhang, Johan Karlsson 외

We consider incremental inference problems from aggregate data for collective dynamics. In particular, we address the problem of estimating the aggregate marginals of a Markov chain from noisy aggregate observations in a…

Learning-Augmented Frequency Estimation in Sliding Windows

2024-09-17 · Rana Shahout, Ibrahim Sabek, Michael Mitzenmacher

We show how to utilize machine learning approaches to improve sliding window algorithms for approximate frequency estimation problems, under the ``algorithms with predictions'' framework. In this dynamic environment, pre…

A2-RL: Aesthetics Aware Reinforcement Learning for Image Cropping

2017-09-14 · CVPR 2018 6 · Debang Li, Huikai Wu, Junge Zhang, Kaiqi Huang

Image cropping aims at improving the aesthetic quality of images by adjusting their composition. Most weakly supervised cropping methods (without bounding box supervision) rely on the sliding window mechanism. The slidin…

Decision MakingImage Croppingreinforcement-learningReinforcement Learning+2