paper-with-me

Papers

Deep Reinforcement Learning for Digital Twin-Oriented Complex Networked Systems

2024-11-09 · Jiaqi Wen, Bogdan Gabrys, Katarzyna Musial

The Digital Twin Oriented Complex Networked System (DT-CNS) aims to build and extend a Complex Networked System (CNS) model with progressively increasing dynamics complexity towards an accurate reflection of reality -- a Digital Twin of reality. Our previous work proposed evolutionary DT-CNSs to model the long-term adaptive network changes in an epidemic outbreak. This study extends this framework by proposeing the temporal DT-CNS model, where reinforcement learning-driven nodes make decisions on temporal directed interactions in an epidemic outbreak. We consider cooperative nodes, as well as egocentric and ignorant "free-riders" in the cooperation. We describe this epidemic spreading process with the Susceptible-Infected-Recovered ($SIR$) model and investigate the impact of epidemic severity on the epidemic resilience for different types of nodes. Our experimental results show that (i) the full cooperation leads to a higher reward and lower infection number than a cooperation with egocentric or ignorant "free-riders"; (ii) an increasing number of "free-riders" in a cooperation leads to a smaller reward, while an increasing number of egocentric "free-riders" further escalate the infection numbers and (iii) higher infection rates and a slower recovery weakens networks' resilience to severe epidemic outbreaks. These findings also indicate that promoting cooperation and reducing "free-riders" can improve public health during epidemics.

📄 PDF Abstract BibTeX arXiv:2411.06148

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learningReinforcement Learning

Similar Papers 제목 키워드 기반

Towards Digital Twin Oriented Modelling of Complex Networked Systems and Their Dynamics: A Comprehensive Survey

2022-02-15 · Jiaqi Wen, Bogdan Gabrys, Katarzyna Musial

This paper aims to provide a comprehensive critical overview on how entities and their interactions in Complex Networked Systems (CNS) are modelled across disciplines as they approach their ultimate goal of creating a Di…

Heterogeneous Feature Representation for Digital Twin-Oriented Complex Networked Systems

2023-09-23 · Jiaqi Wen, Bogdan Gabrys, Katarzyna Musial

Building models of Complex Networked Systems (CNS) that can accurately represent reality forms an important research area. To be able to reflect real world systems, the modelling needs to consider not only the intensity …

Digital Twin-Oriented Complex Networked Systems based on Heterogeneous Node Features and Interaction Rules

2023-08-18 · Jiaqi Wen, Bogdan Gabrys, Katarzyna Musial

This study proposes an extendable modelling framework for Digital Twin-Oriented Complex Networked Systems (DT-CNSs) with a goal of generating networks that faithfully represent real systems. Modelling process focuses on …

Diversity

AI-based traffic analysis in digital twin networks

2024-11-01 · Sarah Al-Shareeda, Khayal Huseynov, Lal Verda Cakir, Craig Thomson 외

In today's networked world, Digital Twin Networks (DTNs) are revolutionizing how we understand and optimize physical networks. These networks, also known as 'Digital Twin Networks (DTNs)' or 'Networks Digital Twins (NDTs…

FairnessFederated LearningReinforcement Learning (RL)

Value-Based Reinforcement Learning for Digital Twins in Cloud Computing

2023-11-27 · Van-Phuc Bui, Shashi Raj Pandey, Pedro M. de Sant Ana, Petar Popovski

The setup considered in the paper consists of sensors in a Networked Control System that are used to build a digital twin (DT) model of the system dynamics. The focus is on control, scheduling, and resource allocation fo…

Cloud Computingreinforcement-learningReinforcement LearningScheduling+1