Resource Optimization for Tail-Based Control in Wireless Networked Control Systems

2024-06-20 · Rasika Vijithasena, Rafaela Scaciota, Mehdi Bennis, Sumudu Samarakoon

Achieving control stability is one of the key design challenges of scalable Wireless Networked Control Systems (WNCS) under limited communication and computing resources. This paper explores the use of an alternative control concept defined as tail-based control, which extends the classical Linear Quadratic Regulator (LQR) cost function for multiple dynamic control systems over a shared wireless network. We cast the control of multiple control systems as a network-wide optimization problem and decouple it in terms of sensor scheduling, plant state prediction, and control policies. Toward this, we propose a solution consisting of a scheduling algorithm based on Lyapunov optimization for sensing, a mechanism based on Gaussian Process Regression (GPR) for state prediction and uncertainty estimation, and a control policy based on Reinforcement Learning (RL) to ensure tail-based control stability. A set of discrete time-invariant mountain car control systems is used to evaluate the proposed solution and is compared against four variants that use state-of-the-art scheduling, prediction, and control methods. The experimental results indicate that the proposed method yields 22% reduction in overall cost in terms of communication and control resource utilization compared to state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2406.14301

Code (0)

등록된 구현이 없습니다.

Tasks

GPRPrediction Reinforcement Learning (RL)Scheduling

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Diffusion Model Based Resource Allocation Strategy in Ultra-Reliable Wireless Networked Control Systems

2024-07-22 · Amirhassan Babazadeh Darabi, Sinem Coleri

Diffusion models are vastly used in generative AI, leveraging their capability to capture complex data distributions. However, their potential remains largely unexplored in the field of resource allocation in wireless ne…

Deep Reinforcement Learning Denoising

Age of Loop for Wireless Networked Control Systems Optimization

2021-06-01 · Pedro M. de Sant Ana, Nikolaj Marchenko, Petar Popovski, Beatriz Soret

Joint design of control and communication in Wireless Networked Control Systems (WNCS) is a promising approach for future wireless industrial applications. In this context, Age of Information (AoI) has been increasingly …

Deep reinforcement learning for scheduling in large-scale networked control systems

2019-05-15 · Adrian Redder, Arunselvan Ramaswamy, Daniel E. Quevedo

This work considers the problem of control and resource scheduling in networked systems. We present DIRA, a Deep reinforcement learning based Iterative Resource Allocation algorithm, which is scalable and control-aware. …

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Optimization Theory Based Deep Reinforcement Learning for Resource Allocation in Ultra-Reliable Wireless Networked Control Systems

2023-11-28 · Hamida Qumber Ali, Amirhassan Babazadeh Darabi, Sinem Coleri

The design of Wireless Networked Control System (WNCS) requires addressing critical interactions between control and communication systems with minimal complexity and communication overhead while providing ultra-high rel…

Deep Reinforcement Learning

Experimental Study of Transport Layer Protocols for Wireless Networked Control Systems

2023-06-18 · Polina Kutsevol, Onur Ayan, Nikolaos Pappas, Wolfgang Kellerer

In Wireless Networked Control Systems (WNCSs), the feedback control loops are closed over a wireless communication network. The proliferation of WNCSs requires efficient network resource management mechanisms since the c…