When Deep Reinforcement Learning Meets Federated Learning: Intelligent Multi-Timescale Resource Management for Multi-access Edge Computing in 5G Ultra Dense Network

2020-09-22 · Shuai Yu, Xu Chen, Zhi Zhou, Xiaowen Gong, Di wu

Ultra-dense edge computing (UDEC) has great potential, especially in the 5G era, but it still faces challenges in its current solutions, such as the lack of: i) efficient utilization of multiple 5G resources (e.g., computation, communication, storage and service resources); ii) low overhead offloading decision making and resource allocation strategies; and iii) privacy and security protection schemes. Thus, we first propose an intelligent ultra-dense edge computing (I-UDEC) framework, which integrates blockchain and Artificial Intelligence (AI) into 5G ultra-dense edge computing networks. First, we show the architecture of the framework. Then, in order to achieve real-time and low overhead computation offloading decisions and resource allocation strategies, we design a novel two-timescale deep reinforcement learning (\textit{2Ts-DRL}) approach, consisting of a fast-timescale and a slow-timescale learning process, respectively. The primary objective is to minimize the total offloading delay and network resource usage by jointly optimizing computation offloading, resource allocation and service caching placement. We also leverage federated learning (FL) to train the \textit{2Ts-DRL} model in a distributed manner, aiming to protect the edge devices' data privacy. Simulation results corroborate the effectiveness of both the \textit{2Ts-DRL} and FL in the I-UDEC framework and prove that our proposed algorithm can reduce task execution time up to 31.87%.

📄 PDF Abstract BibTeX arXiv:2009.10601

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingDeep Reinforcement LearningEdge-computingFederated Learning Management

Scalable Multi-agent Reinforcement Learning Algorithm for Wireless Networks

2021-08-01 · Fenghe Hu, Yansha Deng, A. Hamid Aghvami

Scalability is the key roadstone towards the application of cooperative intelligent algorithms in large-scale networks. Reinforcement learning (RL) is known as model-free and high efficient intelligent algorithm for comm…

Decision Making Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

When Agentic AI Meets Integrated Sensing and Communication

2026-08-06 · Kai Li, Conggai Li, Sarah Ali Siddiqui, Syed Sohail Ahmed 외 arxiv

Agentic artificial intelligence (AI) is transforming Integrated Sensing and Communication (ISAC) from a function-oriented physical-layer technology into a goal-driven, closed-loop intelligent system, a paradigm we term A…

Reinforcement Learning Federated Learning

Optimizing Age of Information in Vehicular Edge Computing with Federated Graph Neural Network Multi-Agent Reinforcement Learning

2024-07-01 · Wenhua Wang, Qiong Wu, Pingyi Fan, Nan Cheng 외

With the rapid development of intelligent vehicles and Intelligent Transport Systems (ITS), the sensors such as cameras and LiDAR installed on intelligent vehicles provides higher capacity of executing computation-intens…

Deep Reinforcement Learning Edge-computing Federated Learning Graph Neural Network+1

PALCAS: A Priority-Aware Intelligent Lane Change Advisory System for Autonomous Vehicles using Federated Reinforcement Learning

2026-04-29 · Yassine Ibork, Nhat Ha Nguyen, Myounggyu Won, Lokesh Das arxiv

We present a priority-aware intelligent lane change advisory system based on multi-agent federated reinforcement learning, namely PALCAS, for autonomous vehicles (AVs). While existing lane-change approaches typically foc…

Reinforcement Learning Autonomous Vehicles

Reinforcement Learning for Scalable and Trustworthy Intelligent Systems

2026-05-08 · Guangchen Lan arxiv

Reinforcement learning has become a powerful paradigm for improving the capability of intelligent systems, but its practical deployment faces two central challenges. First, reinforcement learning must scale efficiently i…

Reinforcement Learning