A Hybrid Framework of Reinforcement Learning and Convex Optimization for UAV-Based Autonomous Metaverse Data Collection

2023-05-29 · Peiyuan Si, Liangxin Qian, Jun Zhao, Kwok-Yan Lam

Unmanned aerial vehicles (UAVs) are promising for providing communication services due to their advantages in cost and mobility, especially in the context of the emerging Metaverse and Internet of Things (IoT). This paper considers a UAV-assisted Metaverse network, in which UAVs extend the coverage of the base station (BS) to collect the Metaverse data generated at roadside units (RSUs). Specifically, to improve the data collection efficiency, resource allocation and trajectory control are integrated into the system model. The time-dependent nature of the optimization problem makes it non-trivial to be solved by traditional convex optimization methods. Based on the proposed UAV-assisted Metaverse network system model, we design a hybrid framework with reinforcement learning and convex optimization to {cooperatively} solve the time-sequential optimization problem. Simulation results show that the proposed framework is able to reduce the mission completion time with a given transmission power resource.

📄 PDF Abstract BibTeX arXiv:2305.18481

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

BASE 설명 없음

Hybrid Group Relative Policy Optimization: A Multi-Sample Approach to Enhancing Policy Optimization

2025-01-30 · Soham Sane

Hybrid Group Relative Policy Optimization (Hybrid GRPO) is a reinforcement learning framework that extends Proximal Policy Optimization (PPO) and Group Relative Policy Optimization (GRPO) by incorporating empirical multi…

reinforcement-learning Reinforcement Learning

A Robust Fuel Optimization Strategy For Hybrid Electric Vehicles: A Deep Reinforcement Learning Based Continuous Time Design Approach

2021-01-01 · Nilanjan Mukherjee, Sudeshna Sarkar

This paper deals with the fuel optimization problem for hybrid electric vehicles in deep reinforcement learning framework. Firstly, considering the hybrid electric vehicle as an uncertain non-linear system with unknown d…

Deep Reinforcement Learning Management reinforcement-learning Reinforcement Learning+1

SARAD: LLM-Based Safety-Aware Hybrid Reinforcement Learning with Collision Prediction for Autonomous Driving

2026-05-27 · Kangyu Wu, Peng Cui, Guoxi Chen, Ya Zhang arxiv

Ensuring both safety and efficiency in decision-making for autonomous driving systems remains a fundamental challenge. Traditional Deep Reinforcement Learning (DRL) suffers from unsafe random exploration and slow converg…

Reinforcement Learning Autonomous Driving

Autonomous Racing using a Hybrid Imitation-Reinforcement Learning Architecture

2021-10-11 · Chinmay Vilas Samak, Tanmay Vilas Samak, Sivanathan Kandhasamy

In this work, we present a rigorous end-to-end control strategy for autonomous vehicles aimed at minimizing lap times in a time attack racing event. We also introduce AutoRACE Simulator developed as a part of this resear…

Autonomous Racing Autonomous Vehicles Imitation Learning reinforcement-learning+2

Game-Theoretic Autonomous Driving: A Graphs of Convex Sets Approach

2026-01-27 · Nikolaj Käfer, Ahmed Khalil, Edward Huynh, Efstathios Bakolas 외 arxiv

Multi-vehicle autonomous driving couples strategic interaction with hybrid (discrete-continuous) maneuver planning under shared safety constraints. We introduce IBR-GCS, an Iterative Best Response (IBR) planning approach…

Trajectory Planning Autonomous Driving