paper-with-me

Papers

Digital Twin-Assisted Data-Driven Optimization for Reliable Edge Caching in Wireless Networks

2024-06-29 · Zifan Zhang, Yuchen Liu, Zhiyuan Peng, Mingzhe Chen, Dongkuan Xu, Shuguang Cui

Optimizing edge caching is crucial for the advancement of next-generation (nextG) wireless networks, ensuring high-speed and low-latency services for mobile users. Existing data-driven optimization approaches often lack awareness of the distribution of random data variables and focus solely on optimizing cache hit rates, neglecting potential reliability concerns, such as base station overload and unbalanced cache issues. This oversight can result in system crashes and degraded user experience. To bridge this gap, we introduce a novel digital twin-assisted optimization framework, called D-REC, which integrates reinforcement learning (RL) with diverse intervention modules to ensure reliable caching in nextG wireless networks. We first develop a joint vertical and horizontal twinning approach to efficiently create network digital twins, which are then employed by D-REC as RL optimizers and safeguards, providing ample datasets for training and predictive evaluation of our cache replacement policy. By incorporating reliability modules into a constrained Markov decision process, D-REC can adaptively adjust actions, rewards, and states to comply with advantageous constraints, minimizing the risk of network failures. Theoretical analysis demonstrates comparable convergence rates between D-REC and vanilla data-driven methods without compromising caching performance. Extensive experiments validate that D-REC outperforms conventional approaches in cache hit rate and load balancing while effectively enforcing predetermined reliability intervention modules.

📄 PDF Abstract BibTeX arXiv:2407.00286

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Focus 설명 없음
BASE 설명 없음

Similar Papers 제목 키워드 기반

Digital Twin-Assisted Knowledge Distillation Framework for Heterogeneous Federated Learning

2023-03-10 · Xiucheng Wang, Nan Cheng, Longfei Ma, Ruijin Sun 외

In this paper, to deal with the heterogeneity in federated learning (FL) systems, a knowledge distillation (KD) driven training framework for FL is proposed, where each user can select its neural network model on demand …

Federated LearningKnowledge DistillationModel SelectionQ-Learning

Digital Twin-Assisted Adaptive Multi-Agent DRL for Intelligent Spectrum and Resource Management in Open-RAN UAV-Enabled 6G Networks

2026-05-31 · Marwan Dhuheir, Thang X. Vu, Symeon Chatzinotas arxiv

The evolution toward 6G wireless networks envisions a seamlessly intelligent, Open-RAN-enabled architecture where unmanned aerial vehicles (UAVs) play a pivotal role in extending coverage, enhancing resilience, and ensur…

Reinforcement Learning

Sparse Attention-driven Quality Prediction for Production Process Optimization in Digital Twins

2024-05-20 · Yanlei Yin, Lihua Wang, Dinh Thai Hoang, Wenbo Wang 외

In the process industry, long-term and efficient optimization of production lines requires real-time monitoring and analysis of operational states to fine-tune production line parameters. However, complexity in operation…

Guided Bayesian Optimization: Data-Efficient Controller Tuning with Digital Twin

2024-03-25 · Mahdi Nobar, Jürg Keller, Alisa Rupenyan, Mohammad Khosravi 외

This article presents the guided Bayesian optimization algorithm as an efficient data-driven method for iteratively tuning closed-loop controller parameters using an event-triggered digital twin of the system based on av…

Bayesian OptimizationGaussian Processes

Mobile Edge Adversarial Detection for Digital Twinning to the Metaverse with Deep Reinforcement Learning

2023-03-18 · Terence Jie Chua, Wenhan Yu, Jun Zhao

Real-time Digital Twinning of physical world scenes onto the Metaverse is necessary for a myriad of applications such as augmented-reality (AR) assisted driving. In AR assisted driving, physical environment scenes are fi…

Deep Reinforcement Learning