Reinforcement Learning-based Dynamic Service Placement in Vehicular Networks

2021-05-31 · Anum Talpur, Mohan Gurusamy

The emergence of technologies such as 5G and mobile edge computing has enabled provisioning of different types of services with different resource and service requirements to the vehicles in a vehicular network.The growing complexity of traffic mobility patterns and dynamics in the requests for different types of services has made service placement a challenging task. A typical static placement solution is not effective as it does not consider the traffic mobility and service dynamics. In this paper, we propose a reinforcement learning-based dynamic (RL-Dynamic) service placement framework to find the optimal placement of services at the edge servers while considering the vehicle's mobility and dynamics in the requests for different types of services. We use SUMO and MATLAB to carry out simulation experiments. In our learning framework, for the decision module, we consider two alternative objective functions-minimizing delay and minimizing edge server utilization. We developed an ILP based problem formulation for the two objective functions. The experimental results show that 1) compared to static service placement, RL-based dynamic service placement achieves fair utilization of edge server resources and low service delay, and 2) compared to delay-optimized placement, server utilization optimized placement utilizes resources more effectively, achieving higher fairness with lower edge-server utilization.

📄 PDF Abstract BibTeX arXiv:2105.15022

Code (0)

등록된 구현이 없습니다.

Tasks

Edge-computingFairness reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

Adversarial Attacks Against Deep Reinforcement Learning Framework in Internet of Vehicles

2021-08-02 · Anum Talpur, Mohan Gurusamy

Machine learning (ML) has made incredible impacts and transformations in a wide range of vehicular applications. As the use of ML in Internet of Vehicles (IoV) continues to advance, adversarial threats and their impact h…

Data Poisoning Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Diffusion-based Reinforcement Learning for Dynamic UAV-assisted Vehicle Twins Migration in Vehicular Metaverses

2024-06-08 · Yongju Tong, Jiawen Kang, Junlong Chen, Minrui Xu 외

Air-ground integrated networks can relieve communication pressure on ground transportation networks and provide 6G-enabled vehicular Metaverses services offloading in remote areas with sparse RoadSide Units (RSUs) covera…

Heuristic Search Reinforcement Learning (RL)

A Deep RL Approach on Task Placement and Scaling of Edge Resources for Cellular Vehicle-to-Network Service Provisioning

2023-05-16 · Cyril Shih-Huan Hsu, Jorge Martín-Pérez, Danny De Vleeschauwer, Luca Valcarenghi 외

Cellular Vehicle-to-Everything (C-V2X) is currently at the forefront of the digital transformation of our society. By enabling vehicles to communicate with each other and with the traffic environment using cellular netwo…

Decision Making Deep Reinforcement Learning

SCAR: State-Space Compression for Scalable AI-Based Network Management of Vehicular Services

2025-08-08 · Ioan-Sorin Comsa, Purav Shah, Karthik Vaidhyanathan, Deepak Gangadharan 외 arxiv

The increasing demand for connected vehicular services poses significant challenges for AI-based network and service management due to the high volume and rapid variability of network state information. Traditional manag…

Reinforcement Learning

DRLD-SP: A Deep Reinforcement Learning-based Dynamic Service Placement in Edge-Enabled Internet of Vehicles

2021-06-11 · Anum Talpur, Mohan Gurusamy

The growth of 5G and edge computing has enabled the emergence of Internet of Vehicles. It supports different types of services with different resource and service requirements. However, limited resources at the edge, hig…

Deep Reinforcement Learning Edge-computing