A Learning Approach for Joint Design of Event-triggered Control and Power-Efficient Resource Allocation
In emerging Industrial Cyber-Physical Systems (ICPSs), the joint design of communication and control sub-systems is essential, as these sub-systems are interconnected. In this paper, we study the joint design problem of an event-triggered control and an energy-efficient resource allocation in a fifth generation (5G) wireless network. We formally state the problem as a multi-objective optimization one, aiming to minimize the number of updates on the actuators' input and the power consumption in the downlink transmission. To address the problem, we propose a model-free hierarchical reinforcement learning approach \textcolor{blue}{with uniformly ultimate boundedness stability guarantee} that learns four policies simultaneously. These policies contain an update time policy on the actuators' input, a control policy, and energy-efficient sub-carrier and power allocation policies. Our simulation results show that the proposed approach can properly control a simulated ICPS and significantly decrease the number of updates on the actuators' input as well as the downlink power consumption.
Code (0)
등록된 구현이 없습니다.
Tasks
Hierarchical Reinforcement LearningSimilar Papers 제목 키워드 기반
Event-Triggered Extended State Observer Based Distributed Control of Nonlinear Vehicle Platoons
We study the platoon control of vehicles with third-order nonlinear dynamics under the constant spacing policy. We consider a vehicle model with parameter uncertainties and external disturbances and propose a distributed…
Event-Triggered Synergistic Controllers with Dwell-Time Transmission
We propose novel event-triggered synergistic controllers for nonlinear continuous-time plants by incorporating event-triggered control into stabilizing synergistic controllers. We highlight that a naive application of co…
Learning Event-triggered Control from Data through Joint Optimization
We present a framework for model-free learning of event-triggered control strategies. Event-triggered methods aim to achieve high control performance while only closing the feedback loop when needed. This enables resourc…
Hierarchical Reinforcement LearningApplication of Event-Triggered Sliding Mode Control of 2-DOF Humanoid's Lower-Limb Powered by Series Elastic Actuator
This paper proposes an event-triggered sliding mode control (SMC) scheme combined with a backstepping algorithm for control of 2-DOF humanoid's lower-limb powered by Series elastic actuator (SEA). First, the modelling pr…
Event-triggered Design for Optimal Output Consensus of High-order Multi-agent Systems
This paper studies the optimal output consensus problem for a group of heterogeneous linear multi-agent systems. Different from existing results, we aim at effective controllers for these high-order agents under both eve…