DeepCAS: A Deep Reinforcement Learning Algorithm for Control-Aware Scheduling

2018-03-08 · Burak Demirel, Arunselvan Ramaswamy, Daniel E. Quevedo, Holger Karl

We consider networked control systems consisting of multiple independent controlled subsystems, operating over a shared communication network. Such systems are ubiquitous in cyber-physical systems, Internet of Things, and large-scale industrial systems. In many large-scale settings, the size of the communication network is smaller than the size of the system. In consequence, scheduling issues arise. The main contribution of this paper is to develop a deep reinforcement learning-based \emph{control-aware} scheduling (\textsc{DeepCAS}) algorithm to tackle these issues. We use the following (optimal) design strategy: First, we synthesize an optimal controller for each subsystem; next, we design a learning algorithm that adapts to the chosen subsystems (plants) and controllers. As a consequence of this adaptation, our algorithm finds a schedule that minimizes the \emph{control loss}. We present empirical results to show that \textsc{DeepCAS} finds schedules with better performance than periodic ones.

📄 PDF Abstract BibTeX arXiv:1803.02998

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Scheduling

Deep reinforcement learning for scheduling in large-scale networked control systems

2019-05-15 · Adrian Redder, Arunselvan Ramaswamy, Daniel E. Quevedo

This work considers the problem of control and resource scheduling in networked systems. We present DIRA, a Deep reinforcement learning based Iterative Resource Allocation algorithm, which is scalable and control-aware. …

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Semantic-aware Transmission Scheduling: a Monotonicity-driven Deep Reinforcement Learning Approach

2023-05-23 · Jiazheng Chen, Wanchun Liu, Daniel Quevedo, Yonghui Li 외

For cyber-physical systems in the 6G era, semantic communications connecting distributed devices for dynamic control and remote state estimation are required to guarantee application-level performance, not merely focus o…

Decision Making Deep Reinforcement Learning reinforcement-learning Scheduling+1

On the Effect of Ruleset Tuning and Data Imbalance on Explainable Network Security Alert Classifications: a Case-Study on DeepCASE

2025-07-02 · Koen T. W. Teuwen, Sam Baggen, Emmanuele Zambon, Luca Allodi arxiv

Automation in Security Operations Centers (SOCs) plays a prominent role in alert classification and incident escalation. However, automated methods must be robust in the presence of imbalanced input data, which can negat…

Out-of-Distribution-Aware Electric Vehicle Charging

2023-11-10 · Tongxin Li, Chenxi Sun

We tackle the challenge of learning to charge Electric Vehicles (EVs) with Out-of-Distribution (OOD) data. Traditional scheduling algorithms typically fail to balance near-optimal average performance with worst-case guar…

Model Predictive Control reinforcement-learning Reinforcement Learning (RL)Scheduling

Dependency-Aware CAV Task Scheduling via Diffusion-Based Reinforcement Learning

2024-11-27 · Xiang Cheng, Zhi Mao, Ying Wang, Wen Wu

In this paper, we propose a novel dependency-aware task scheduling strategy for dynamic unmanned aerial vehicle-assisted connected autonomous vehicles (CAVs). Specifically, different computation tasks of CAVs consisting …

Autonomous Vehicles reinforcement-learning Reinforcement Learning Scheduling