홈 › Papers

Age of Information Aware VNF Scheduling in Industrial IoT Using Deep Reinforcement Learning

2021-05-10 · Mohammad Akbari, Mohammad Reza Abedi, Roghayeh Joda, Mohsen Pourghasemian, Nader Mokari, Melike Erol-Kantarci

In delay-sensitive industrial internet of things (IIoT) applications, the age of information (AoI) is employed to characterize the freshness of information. Meanwhile, the emerging network function virtualization provides flexibility and agility for service providers to deliver a given network service using a sequence of virtual network functions (VNFs). However, suitable VNF placement and scheduling in these schemes is NP-hard and finding a globally optimal solution by traditional approaches is complex. Recently, deep reinforcement learning (DRL) has appeared as a viable way to solve such problems. In this paper, we first utilize single agent low-complex compound action actor-critic RL to cover both discrete and continuous actions and jointly minimize VNF cost and AoI in terms of network resources under end-to end Quality of Service constraints. To surmount the single-agent capacity limitation for learning, we then extend our solution to a multi-agent DRL scheme in which agents collaborate with each other. Simulation results demonstrate that single-agent schemes significantly outperform the greedy algorithm in terms of average network cost and AoI. Moreover, multi-agent solution decreases the average cost by dividing the tasks between the agents. However, it needs more iterations to be learned due to the requirement on the agents collaboration.

📄 PDF Abstract BibTeX arXiv:2105.04207

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning (RL)Scheduling

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

DeepCAS: A Deep Reinforcement Learning Algorithm for Control-Aware Scheduling

2018-03-08 · Burak Demirel, Arunselvan Ramaswamy, Daniel E. Quevedo, Holger Karl

We consider networked control systems consisting of multiple independent controlled subsystems, operating over a shared communication network. Such systems are ubiquitous in cyber-physical systems, Internet of Things, an…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Reinforcement Learning-Based Production Scheduling in an Industry-Based Coating Scenario Using the Digital Model Playground

2026-08-14 · Arne Kröger, Ralf Buschermöhle, Wilhelm Hasselbring, Henrik Wilbers arxiv

Production scheduling in complex manufacturing environments is challenging when sequence-dependent setup times, stochastic disturbances, and due-date constraints must be addressed simultaneously. While reinforcement lear…

Reinforcement Learning

Semantic-aware Transmission Scheduling: a Monotonicity-driven Deep Reinforcement Learning Approach

2023-05-23 · Jiazheng Chen, Wanchun Liu, Daniel Quevedo, Yonghui Li 외

For cyber-physical systems in the 6G era, semantic communications connecting distributed devices for dynamic control and remote state estimation are required to guarantee application-level performance, not merely focus o…

Decision Making Deep Reinforcement Learning reinforcement-learning Scheduling+1

Buffer-aware Wireless Scheduling based on Deep Reinforcement Learning

2019-11-13 · Chen Xu, Jian Wang, Tianhang Yu, Chuili Kong 외

In this paper, the downlink packet scheduling problem for cellular networks is modeled, which jointly optimizes throughput, fairness and packet drop rate. Two genie-aided heuristic search methods are employed to explore …

Deep Reinforcement Learning Fairness Heuristic Search reinforcement-learning+3

RL-ASL: A Dynamic Listening Optimization for TSCH Networks Using Reinforcement Learning

2026-04-08 · F. Fernando Jurado-Lasso, J. F. Jurado arxiv

Time Slotted Channel Hopping (TSCH) is a widely adopted Media Access Control (MAC) protocol within the IEEE 802.15.4e standard, designed to provide reliable and energy-efficient communication in Industrial Internet of Th…