Knowledge-Driven Multi-Agent Reinforcement Learning for Computation Offloading in Cybertwin-Enabled Internet of Vehicles

2023-08-04 · Ruijin Sun, Xiao Yang, Nan Cheng, Xiucheng Wang, Changle Li

By offloading computation-intensive tasks of vehicles to roadside units (RSUs), mobile edge computing (MEC) in the Internet of Vehicles (IoV) can relieve the onboard computation burden. However, existing model-based task offloading methods suffer from heavy computational complexity with the increase of vehicles and data-driven methods lack interpretability. To address these challenges, in this paper, we propose a knowledge-driven multi-agent reinforcement learning (KMARL) approach to reduce the latency of task offloading in cybertwin-enabled IoV. Specifically, in the considered scenario, the cybertwin serves as a communication agent for each vehicle to exchange information and make offloading decisions in the virtual space. To reduce the latency of task offloading, a KMARL approach is proposed to select the optimal offloading option for each vehicle, where graph neural networks are employed by leveraging domain knowledge concerning graph-structure communication topology and permutation invariance into neural networks. Numerical results show that our proposed KMARL yields higher rewards and demonstrates improved scalability compared with other methods, benefitting from the integration of domain knowledge.

📄 PDF Abstract BibTeX arXiv:2308.02603

Code (0)

등록된 구현이 없습니다.

Tasks

Edge-computingMulti-agent Reinforcement Learning

Hybrid Information-driven Multi-agent Reinforcement Learning

2021-02-01 · William A. Dawson, Ruben Glatt, Edward Rusu, Braden C. Soper 외

Information theoretic sensor management approaches are an ideal solution to state estimation problems when considering the optimal control of multi-agent systems, however they are too computationally intensive for large …

Management Multi-agent Reinforcement Learning Navigate reinforcement-learning+3

Data-Driven Mean Field Equilibrium Computation in Large-Population LQG Games

2025-02-27 · Zhenhui Xu, Jiayu Chen, Bing-Chang Wang, Tielong Shen

This paper presents a novel data-driven approach for approximating the $\varepsilon$-Nash equilibrium in continuous-time linear quadratic Gaussian (LQG) games, where multiple agents interact with each other through their…

Learning Invariant Feature Spaces to Transfer Skills with Reinforcement Learning

2017-03-08 · Abhishek Gupta, Coline Devin, Yuxuan Liu, Pieter Abbeel 외

People can learn a wide range of tasks from their own experience, but can also learn from observing other creatures. This can accelerate acquisition of new skills even when the observed agent differs substantially from t…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Transfer Learning

LLM-Guided Communication for Cooperative Multi-Agent Reinforcement Learning

2026-05-18 · Sangjun Bae, Yisak Park, Sanghyeon Lee, Seungyul Han arxiv

Communication is a key component in multi-agent reinforcement learning (MARL) for mitigating partial observability, yet prior approaches often rely on inefficient information exchange or fail to transmit sufficient state…

Multi-agent Reinforcement Learning

KnowPC: Knowledge-Driven Programmatic Reinforcement Learning for Zero-shot Coordination

2024-08-08 · Yin Gu, Qi Liu, Zhi Li, Kai Zhang

Zero-shot coordination (ZSC) remains a major challenge in the cooperative AI field, which aims to learn an agent to cooperate with an unseen partner in training environments or even novel environments. In recent years, a…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning