Autonomous Maintenance in IoT Networks via AoI-driven Deep Reinforcement Learning

2020-12-31 · George Stamatakis, Nikolaos Pappas, Alexandros Fragkiadakis, Apostolos Traganitis

Internet of Things (IoT) with its growing number of deployed devices and applications raises significant challenges for network maintenance procedures. In this work, we formulate a problem of autonomous maintenance in IoT networks as a Partially Observable Markov Decision Process. Subsequently, we utilize Deep Reinforcement Learning algorithms (DRL) to train agents that decide if a maintenance procedure is in order or not and, in the former case, the proper type of maintenance needed. To avoid wasting the scarce resources of IoT networks we utilize the Age of Information (AoI) metric as a reward signal for the training of the smart agents. AoI captures the freshness of the sensory data which are transmitted by the IoT sensors as part of their normal service provision. Numerical results indicate that AoI integrates enough information about the past and present states of the system to be successfully used in the training of smart agents for the autonomous maintenance of the network.

📄 PDF Abstract BibTeX arXiv:2012.15548

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

TranDRL: A Transformer-Driven Deep Reinforcement Learning Enabled Prescriptive Maintenance Framework

2023-09-29 · Yang Zhao, Jiaxi Yang, Wenbo Wang, Helin Yang 외

Industrial systems demand reliable predictive maintenance strategies to enhance operational efficiency and reduce downtime. This paper introduces an integrated framework that leverages the capabilities of the Transformer…

Deep Reinforcement Learning reinforcement-learning

Reinforcement and Deep Reinforcement Learning-based Solutions for Machine Maintenance Planning, Scheduling Policies, and Optimization

2023-07-07 · Oluwaseyi Ogunfowora, Homayoun Najjaran

Systems and machines undergo various failure modes that result in machine health degradation, so maintenance actions are required to restore them back to a state where they can perform their expected functions. Since mai…

Decision Making Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Reinforcement learning-based dynamic cleaning scheduling framework for solar energy system

2026-03-08 · Heungjo An arxiv

Advancing autonomous green technologies in solar photovoltaic (PV) systems is key to improving sustainability and efficiency in renewable energy production. This study presents a reinforcement learning (RL)-based framewo…

Reinforcement Learning

Towards Autonomous Pipeline Inspection with Hierarchical Reinforcement Learning

2021-07-08 · Nicolò Botteghi, Luuk Grefte, Mannes Poel, Beril Sirmacek 외

Inspection and maintenance are two crucial aspects of industrial pipeline plants. While robotics has made tremendous progress in the mechanic design of in-pipe inspection robots, the autonomous control of such robots is …

Autonomous Navigation Deep Reinforcement Learning Hierarchical Reinforcement Learning reinforcement-learning+2

A maturity framework for data driven maintenance

2024-07-26 · Chris Rijsdijk, Mike van de Wijnckel, Tiedo Tinga

Maintenance decisions range from the simple detection of faults to ultimately predicting future failures and solving the problem. These traditionally human decisions are nowadays increasingly supported by data and the ul…

Fault Detection