Infinite-horizon optimal scheduling for feedback control
Emerging cyber-physical systems impel the development of communication protocols that optimize resource utilization. This article investigates infinite-horizon optimal scheduling for resource-aware networked control systems by addressing the rate-regulation tradeoff. Consider a scenario where the sensor and the controller communicate via a networked channel, the transmission scheduling problem is formulated as a Markov decision process on unbounded general state space controlled by scheduling decisions. The value of information (VoI) serves as a metric to assess the importance of sensory data for transmission. We derive the optimal scheduling law for feedback control based on VoI and show that it is deterministic and stationary, with an explicit expression obtained via value iteration. The closed-loop system under the designed scheduling law is shown to be stochastically stable. By analyzing the dynamic behavior of the iteration process, we show that the VoI function and the optimal scheduling law exhibit symmetry. Furthermore, when the system matrix is diagonalizable, the VoI function is monotone and quasi-convex. Consequently, the optimal scheduling law is shown to exhibit a threshold structure and takes a quadratic form, with the threshold region explicitly characterized. Finally, the numerical simulation illustrates the theoretical result of the VoI-based scheduling.
Code (0)
등록된 구현이 없습니다.
Tasks
SchedulingSimilar Papers 제목 키워드 기반
Mixed-horizon optimal feedback control as a model of human movement
Computational optimal feedback control (OFC) models in the sensorimotor control literature span a vast range of different implementations. Among the popular algorithms, finite-horizon, receding-horizon or infinite-horizo…
Optimal Transmission Power Scheduling for Networked Control System under DoS Attack
Designing networked control systems that are reliable and resilient against adversarial threats, is essential for ensuring the security of cyber-physical systems. This paper addresses the communication-control co-design …
SchedulingSeparation is Optimal for LQR under Intermittent Feedback
We study finite-horizon linear-quadratic regulation of a scalar linear system with intermittent state feedback under an average communication-rate constraint. In this setting, the scheduling policy and controller are gen…
On receding-horizon approximation in time-varying optimal control
The closed-loop stability and infinite-horizon performance of receding-horizon approximations are studied for non-stationary linear-quadratic regulator (LQR) problems. The approach is based on a lifted reformulation of t…
Deep Reinforcement Learning Based Optimal Infinite-Horizon Control of Probabilistic Boolean Control Networks
In this paper, a deep reinforcement learning based method is proposed to obtain optimal policies for optimal infinite-horizon control of probabilistic Boolean control networks (PBCNs). Compared with the existing literatu…
Deep Reinforcement LearningQ-Learningreinforcement-learningReinforcement Learning