Computation Offloading and Resource Allocation in F-RANs: A Federated Deep Reinforcement Learning Approach

2022-06-13 · Lingling Zhang, Yanxiang Jiang, Fu-Chun Zheng, Mehdi Bennis, Xiaohu You

The fog radio access network (F-RAN) is a promising technology in which the user mobile devices (MDs) can offload computation tasks to the nearby fog access points (F-APs). Due to the limited resource of F-APs, it is important to design an efficient task offloading scheme. In this paper, by considering time-varying network environment, a dynamic computation offloading and resource allocation problem in F-RANs is formulated to minimize the task execution delay and energy consumption of MDs. To solve the problem, a federated deep reinforcement learning (DRL) based algorithm is proposed, where the deep deterministic policy gradient (DDPG) algorithm performs computation offloading and resource allocation in each F-AP. Federated learning is exploited to train the DDPG agents in order to decrease the computing complexity of training process and protect the user privacy. Simulation results show that the proposed federated DDPG algorithm can achieve lower task execution delay and energy consumption of MDs more quickly compared with the other existing strategies.

📄 PDF Abstract BibTeX arXiv:2206.05881

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningFederated Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Experience Replay Experience Replay is a replay memory technique used in reinforcement learning where we store the agent’s experiences at each time-step, $e\_{t} = \left(s\_{t}, a\_{t}, r\_{t},…

Batch Normalization 설명 없음

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Weight Decay 설명 없음

Adam 설명 없음

DDPG DDPG, or Deep Deterministic Policy Gradient, is an actor-critic, model-free algorithm based on the deterministic policy gradient that can operate over continuous action…

Federated Double Deep Q-learning for Joint Delay and Energy Minimization in IoT networks

2021-04-02 · Sheyda Zarandi, Hina Tabassum

In this paper, we propose a federated deep reinforcement learning framework to solve a multi-objective optimization problem, where we consider minimizing the expected long-term task completion delay and energy consumptio…

Deep Reinforcement Learning Federated Learning Q-Learning reinforcement-learning+2

When Deep Reinforcement Learning Meets Federated Learning: Intelligent Multi-Timescale Resource Management for Multi-access Edge Computing in 5G Ultra Dense Network

2020-09-22 · Shuai Yu, Xu Chen, Zhi Zhou, Xiaowen Gong 외

Ultra-dense edge computing (UDEC) has great potential, especially in the 5G era, but it still faces challenges in its current solutions, such as the lack of: i) efficient utilization of multiple 5G resources (e.g., compu…

Decision Making Deep Reinforcement Learning Edge-computing Federated Learning+1

DRL-Based Federated Self-Supervised Learning for Task Offloading and Resource Allocation in ISAC-Enabled Vehicle Edge Computing

2024-08-27 · Xueying Gu, Qiong Wu, Pingyi Fan, Nan Cheng 외

Intelligent Transportation Systems (ITS) leverage Integrated Sensing and Communications (ISAC) to enhance data exchange between vehicles and infrastructure in the Internet of Vehicles (IoV). This integration inevitably i…

CPU Edge-computing ISAC Self-Supervised Learning

Joint Semantic Transmission and Resource Allocation for Intelligent Computation Task Offloading in MEC Systems

2025-03-11 · Yuanpeng Zheng, Tiankui Zhang, Xidong Mu, Yuanwei Liu 외

Mobile edge computing (MEC) enables the provision of high-reliability and low-latency applications by offering computation and storage resources in close proximity to end-users. Different from traditional computation tas…

Edge-computing

Latency Optimization for Blockchain-Empowered Federated Learning in Multi-Server Edge Computing

2022-03-18 · Dinh C. Nguyen, Seyyedali Hosseinalipour, David J. Love, Pubudu N. Pathirana 외

In this paper, we study a new latency optimization problem for blockchain-based federated learning (BFL) in multi-server edge computing. In this system model, distributed mobile devices (MDs) communicate with a set of ed…

Deep Reinforcement Learning Edge-computing Federated Learning Model Poisoning