Dependency-Aware CAV Task Scheduling via Diffusion-Based Reinforcement Learning

2024-11-27 · Xiang Cheng, Zhi Mao, Ying Wang, Wen Wu

In this paper, we propose a novel dependency-aware task scheduling strategy for dynamic unmanned aerial vehicle-assisted connected autonomous vehicles (CAVs). Specifically, different computation tasks of CAVs consisting of multiple dependency subtasks are judiciously assigned to nearby CAVs or the base station for promptly completing tasks. Therefore, we formulate a joint scheduling priority and subtask assignment optimization problem with the objective of minimizing the average task completion time. The problem aims at improving the long-term system performance, which is reformulated as a Markov decision process. To solve the problem, we further propose a diffusion-based reinforcement learning algorithm, named Synthetic DDQN based Subtasks Scheduling, which can make adaptive task scheduling decision in real time. A diffusion model-based synthetic experience replay is integrated into the reinforcement learning framework, which can generate sufficient synthetic data in experience replay buffer, thereby significantly accelerating convergence and improving sample efficiency. Simulation results demonstrate the effectiveness of the proposed algorithm on reducing task completion time, comparing to benchmark schemes.

📄 PDF Abstract BibTeX arXiv:2411.18230

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Vehicles reinforcement-learning Reinforcement LearningScheduling

Methods 이 논문이 사용한 방법론

Experience Replay Experience Replay is a replay memory technique used in reinforcement learning where we store the agent’s experiences at each time-step, $e\_{t} = \left(s\_{t}, a\_{t}, r\_{t},…

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

BASE 설명 없음

Multi-level Explanation of Deep Reinforcement Learning-based Scheduling

2022-09-18 · Shaojun Zhang, Chen Wang, Albert Zomaya

Dependency-aware job scheduling in the cluster is NP-hard. Recent work shows that Deep Reinforcement Learning (DRL) is capable of solving it. It is difficult for the administrator to understand the DRL-based policy even …

Decision Making Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+2

Diffusion-Modeled Reinforcement Learning for Carbon and Risk-Aware Microgrid Optimization

2025-07-22 · Yunyi Zhao, Wei Zhang, Cheng Xiang, Hongyang Du 외 arxiv

This paper introduces DiffCarl, a diffusion-modeled carbon- and risk-aware reinforcement learning algorithm for intelligent operation of multi-microgrid systems. With the growing integration of renewables and increasing …

Reinforcement Learning

Multi-AUV Cooperative Target Tracking Based on Supervised Diffusion-Aided Multi-Agent Reinforcement Learning

2026-03-31 · Jiaao Ma, Chuan Lin, Guangjie Han, Shengchao Zhu 외 arxiv

In recent years, advances in underwater networking and multi-agent reinforcement learning (MARL) have significantly expanded multi-autonomous underwater vehicle (AUV) applications in marine exploration and target trackin…

Multi-agent Reinforcement Learning

Concept Unlearning by Modeling Key Steps of Diffusion Process

2025-07-09 · Chaoshuo Zhang, Chenhao Lin, Zhengyu Zhao, Le Yang 외 arxiv

Text-to-image diffusion models remain susceptible to generating undesirable or harmful content. Although concept unlearning mitigates this risk, existing methods struggle with a critical optimization dilemma: thorough se…

Diffusion Model-based Reinforcement Learning for Version Age of Information Scheduling: Average and Tail-Risk-Sensitive Control

2026-01-26 · Haoyuan Pan, Sizhao Chen, Zhaorui Wang, Tse-Tin Chan arxiv

Ensuring timely and semantically accurate information delivery is critical in real-time wireless systems. While Age of Information (AoI) quantifies temporal freshness, Version Age of Information (VAoI) captures semantic …