Safe Learning for Near Optimal Scheduling
In this paper, we investigate the combination of synthesis, model-based learning, and online sampling techniques to obtain safe and near-optimal schedulers for a preemptible task scheduling problem. Our algorithms can handle Markov decision processes (MDPs) that have 1020 states and beyond which cannot be handled with state-of-the art probabilistic model-checkers. We provide probably approximately correct (PAC) guarantees for learning the model. Additionally, we extend Monte-Carlo tree search with advice, computed using safety games or obtained using the earliest-deadline-first scheduler, to safely explore the learned model online. Finally, we implemented and compared our algorithms empirically against shielded deep Q-learning on large task systems.
Code (0)
등록된 구현이 없습니다.
Tasks
Q-LearningSchedulingSimilar Papers 제목 키워드 기반
Scheduling for Urban Air Mobility using Safe Learning
This work considers the scheduling problem for Urban Air Mobility (UAM) vehicles travelling between origin-destination pairs with both hard and soft trip deadlines. Each route is described by a discrete probability distr…
SchedulingSafety Verification and Control for Collision Avoidance at Road Intersections
This paper presents the design of a supervisory algorithm that monitors safety at road intersections and overrides drivers with a safe input when necessary. The design of the supervisor consists of two parts: safety veri…
BlockingCollision AvoidanceSchedulingData Driven Safe Gain-Scheduling Control
Data-based safe gain-scheduling controllers are presented for discrete-time linear parameter-varying systems (LPV) with polytopic models. First, $\lambda$-contractivity conditions are provided under which safety and stab…
SchedulingSeparation is Optimal for LQR under Intermittent Feedback
We study finite-horizon linear-quadratic regulation of a scalar linear system with intermittent state feedback under an average communication-rate constraint. In this setting, the scheduling policy and controller are gen…
Bi-Level Online Provisioning and Scheduling with Switching Costs and Cross-Level Constraints
We study a bi-level online provisioning and scheduling problem motivated by network resource allocation, where provisioning decisions are made at a slow time scale while queue-/state-dependent scheduling is performed at …