Multi-Agent Deep Reinforcement Learning in Vehicular OCC

2022-05-05 · Amirul Islam, Leila Musavian, Nikolaos Thomos

Optical camera communications (OCC) has emerged as a key enabling technology for the seamless operation of future autonomous vehicles. In this paper, we introduce a spectral efficiency optimization approach in vehicular OCC. Specifically, we aim at optimally adapting the modulation order and the relative speed while respecting bit error rate and latency constraints. As the optimization problem is NP-hard problem, we model the optimization problem as a Markov decision process (MDP) to enable the use of solutions that can be applied online. We then relaxed the constrained problem by employing Lagrange relaxation approach before solving it by multi-agent deep reinforcement learning (DRL). We verify the performance of our proposed scheme through extensive simulations and compare it with various variants of our approach and a random method. The evaluation shows that our system achieves significantly higher sum spectral efficiency compared to schemes under comparison.

📄 PDF Abstract BibTeX arXiv:2205.02672

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous VehiclesDeep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

An approach to implement Reinforcement Learning for Heterogeneous Vehicular Networks

2022-08-26 · Bhavya Peshavaria, Sagar Kavaiya, Dhaval K. Patel

This paper presents the extension of the idea of spectrum sharing in the vehicular networks towards the Heterogeneous Vehicular Network(HetVNET) based on multi-agent reinforcement learning. Here, the multiple vehicle-to-…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Multi-Agent DRL-Based Framework for Optimal Resource Allocation and Twin Migration in the Multi-Tier Vehicular Metaverse

2025-02-26 · Nahom Abishu Hayla, A. Mohammed Seid, Aiman Erbad, Tilahun M. Getu 외

Although multi-tier vehicular Metaverse promises to transform vehicles into essential nodes -- within an interconnected digital ecosystem -- using efficient resource allocation and seamless vehicular twin (VT) migration,…

Deep Reinforcement Learning

Multi-Agent Deep Reinforcement Learning enabled Computation Resource Allocation in a Vehicular Cloud Network

2020-08-14 · Shilin Xu, Caili Guo, Rose Qingyang Hu, Yi Qian

In this paper, we investigate the computational resource allocation problem in a distributed Ad-Hoc vehicular network with no centralized infrastructure support. To support the ever increasing computational needs in such…

Combinatorial Optimization Deep Reinforcement Learning Reinforcement Learning (RL)

Eco-Vehicular Edge Networks for Connected Transportation: A Distributed Multi-Agent Reinforcement Learning Approach

2020-06-17

This paper introduces an energy-efficient, software-defined vehicular edge network for the growing intelligent connected transportation system. A joint user-centric virtual cell formation and resource allocation problem …

Autonomous Vehicles Multi-agent Reinforcement Learning Reinforcement Learning (RL)

Intelligent Offloading in Vehicular Edge Computing: A Comprehensive Review of Deep Reinforcement Learning Approaches and Architectures

2025-02-10 · Ashab Uddin, Ahmed Hamdi Sakr, Ning Zhang

The increasing complexity of Intelligent Transportation Systems (ITS) has led to significant interest in computational offloading to external infrastructures such as edge servers, vehicular nodes, and UAVs. These dynamic…

Decision Making Deep Reinforcement Learning Edge-computing Fairness+3