Cooperative Task Offloading and Block Mining in Blockchain-based Edge Computing with Multi-agent Deep Reinforcement Learning
The convergence of mobile edge computing (MEC) and blockchain is transforming the current computing services in mobile networks, by offering task offloading solutions with security enhancement empowered by blockchain mining. Nevertheless, these important enabling technologies have been studied separately in most existing works. This article proposes a novel cooperative task offloading and block mining (TOBM) scheme for a blockchain-based MEC system where each edge device not only handles data tasks but also deals with block mining for improving the system utility. To address the latency issues caused by the blockchain operation in MEC, we develop a new Proof-of-Reputation consensus mechanism based on a lightweight block verification strategy. A multi-objective function is then formulated to maximize the system utility of the blockchain-based MEC system, by jointly optimizing offloading decision, channel selection, transmit power allocation, and computational resource allocation. We propose a novel distributed deep reinforcement learning-based approach by using a multi-agent deep deterministic policy gradient algorithm. We then develop a game-theoretic solution to model the offloading and mining competition among edge devices as a potential game, and prove the existence of a pure Nash equilibrium. Simulation results demonstrate the significant system utility improvements of our proposed scheme over baseline approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
channel selectionDeep Reinforcement LearningEdge-computingSimilar Papers 제목 키워드 기반
Privacy-Preserved Task Offloading in Mobile Blockchain with Deep Reinforcement Learning
Blockchain technology with its secure, transparent and decentralized nature has been recently employed in many mobile applications. However, the mining process in mobile blockchain requires high computational and storage…
Deep Reinforcement LearningEdge-computingreinforcement-learningReinforcement Learning (RL)Efficient Mining Cluster Selection for Blockchain-based Cellular V2X Communications
Cellular vehicle-to-everything (V2X) communication is expected to herald the age of autonomous vehicles in the coming years. With the integration of blockchain in such networks, information of all granularity levels, fro…
Autonomous VehiclesFairnessLatency Optimization for Blockchain-Empowered Federated Learning in Multi-Server Edge Computing
In this paper, we study a new latency optimization problem for blockchain-based federated learning (BFL) in multi-server edge computing. In this system model, distributed mobile devices (MDs) communicate with a set of ed…
Deep Reinforcement LearningEdge-computingFederated LearningModel PoisoningSecure Computation Offloading in Blockchain based IoT Networks with Deep Reinforcement Learning
For current and future Internet of Things (IoT) networks, mobile edge-cloud computation offloading (MECCO) has been regarded as a promising means to support delay-sensitive IoT applications. However, offloading mobile ta…
Deep Reinforcement LearningManagementreinforcement-learningReinforcement Learning (RL)Energy-Efficient and Physical Layer Secure Computation Offloading in Blockchain-Empowered Internet of Things
This paper investigates computation offloading in blockchain-empowered Internet of Things (IoT), where the task data uploading link from sensors to a base station (BS) is protected by intelligent reflecting surface (IRS)…
Edge-computing