paper-with-me

Papers

A Nested Graph Reinforcement Learning-based Decision-making Strategy for Eco-platooning

2024-08-14 · Xin Gao, Xueyuan Li, Hao liu, Ao Li, Zhaoyang Ma, Zirui Li

Platooning technology is renowned for its precise vehicle control, traffic flow optimization, and energy efficiency enhancement. However, in large-scale mixed platoons, vehicle heterogeneity and unpredictable traffic conditions lead to virtual bottlenecks. These bottlenecks result in reduced traffic throughput and increased energy consumption within the platoon. To address these challenges, we introduce a decision-making strategy based on nested graph reinforcement learning. This strategy improves collaborative decision-making, ensuring energy efficiency and alleviating congestion. We propose a theory of nested traffic graph representation that maps dynamic interactions between vehicles and platoons in non-Euclidean spaces. By incorporating spatio-temporal weighted graph into a multi-head attention mechanism, we further enhance the model's capacity to process both local and global data. Additionally, we have developed a nested graph reinforcement learning framework to enhance the self-iterative learning capabilities of platooning. Using the I-24 dataset, we designed and conducted comparative algorithm experiments, generalizability testing, and permeability ablation experiments, thereby validating the proposed strategy's effectiveness. Compared to the baseline, our strategy increases throughput by 10% and decreases energy use by 9%. Specifically, increasing the penetration rate of CAVs significantly enhances traffic throughput, though it also increases energy consumption.

📄 PDF Abstract BibTeX arXiv:2408.07578

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Makingreinforcement-learningReinforcement Learning

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

Nested Optimal Transport Distances

2025-09-08 · Ruben Bontorno, Songyan Hou arxiv

Simulating realistic financial time series is essential for stress testing, scenario generation, and decision-making under uncertainty. Despite advances in deep generative models, there is no consensus metric for their e…

Reinforcement Learning

Nested Policy Reinforcement Learning for Clinical Decision Support

2021-09-29 · Aishwarya Mandyam, Andrew Jones, Krzysztof Laudanski, Barbara Engelhardt

Off-policy reinforcement learning (RL) has proven to be a powerful framework for guiding agents' actions in environments with stochastic rewards and unknown or noisy state dynamics. In many real-world settings, these age…

Decision MakingNavigateOpenAI Gymreinforcement-learning+2

Multi-layer Abstraction for Nested Generation of Options (MANGO) in Hierarchical Reinforcement Learning

2025-08-25 · Alessio Arcudi, Davide Sartor, Alberto Sinigaglia, Vincent François-Lavet 외 arxiv

This paper introduces MANGO (Multilayer Abstraction for Nested Generation of Options), a novel hierarchical reinforcement learning framework designed to address the challenges of long-term sparse reward environments. MAN…

Hierarchical Reinforcement Learning

HGFormer: A Hierarchical Graph Transformer Framework for Two-Stage Colonel Blotto Games via Reinforcement Learning

2025-06-10 · Yang Lv, Jinlong Lei, Peng Yi

Two-stage Colonel Blotto game represents a typical adversarial resource allocation problem, in which two opposing agents sequentially allocate resources in a network topology across two phases: an initial resource deploy…

Decision MakingGraph Neural Network

Safe Decision-making for Lane-change of Autonomous Vehicles via Human Demonstration-aided Reinforcement Learning

2022-07-01 · Jingda Wu, Wenhui Huang, Niels de Boer, Yanghui Mo 외

Decision-making is critical for lane change in autonomous driving. Reinforcement learning (RL) algorithms aim to identify the values of behaviors in various situations and thus they become a promising pathway to address …

Autonomous DrivingAutonomous VehiclesDecision MakingReinforcement Learning (RL)