Trajectory Entropy: Modeling Game State Stability from Multimodality Trajectory Prediction

2025-06-06 · Yesheng Zhang, Wenjian Sun, YuHeng Chen, Qingwei Liu, Qi Lin, Rui Zhang, Xu Zhao

Complex interactions among agents present a significant challenge for autonomous driving in real-world scenarios. Recently, a promising approach has emerged, which formulates the interactions of agents as a level-k game framework. It effectively decouples agent policies by hierarchical game levels. However, this framework ignores both the varying driving complexities among agents and the dynamic changes in agent states across game levels, instead treating them uniformly. Consequently, redundant and error-prone computations are introduced into this framework. To tackle the issue, this paper proposes a metric, termed as Trajectory Entropy, to reveal the game status of agents within the level-k game framework. The key insight stems from recognizing the inherit relationship between agent policy uncertainty and the associated driving complexity. Specifically, Trajectory Entropy extracts statistical signals representing uncertainty from the multimodality trajectory prediction results of agents in the game. Then, the signal-to-noise ratio of this signal is utilized to quantify the game status of agents. Based on the proposed Trajectory Entropy, we refine the current level-k game framework through a simple gating mechanism, significantly improving overall accuracy while reducing computational costs. Our method is evaluated on the Waymo and nuPlan datasets, in terms of trajectory prediction, open-loop and closed-loop planning tasks. The results demonstrate the state-of-the-art performance of our method, with precision improved by up to 19.89% for prediction and up to 16.48% for planning.

📄 PDF Abstract BibTeX arXiv:2506.05810

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving Trajectory Prediction

Entropy Regularization for Mean Field Games with Learning

2020-09-30 · Xin Guo, Renyuan Xu, Thaleia Zariphopoulou

Entropy regularization has been extensively adopted to improve the efficiency, the stability, and the convergence of algorithms in reinforcement learning. This paper analyzes both quantitatively and qualitatively the imp…

reinforcement-learning Reinforcement Learning (RL)Scheduling

STAPO: Selective Trajectory-Aware Policy Optimization for LLM Agent Training

2026-07-06 · Qiuyi Qi, Tian Liang, Mutian Bao, Jinjian Zhang 외 arxiv

Reinforcement Learning (RL) is the dominant paradigm for training Large Language Model (LLM) agents on long-horizon tasks. However, sparse and delayed rewards often lead to trajectory neglect, in which agents lose focus …

Reinforcement Learning

Mind Your Entropy: From Maximum Entropy to Trajectory Entropy-Constrained RL

2025-10-25 · Guojian Zhan, Likun Wang, Pengcheng Wang, Feihong Zhang 외 arxiv

Maximum entropy has become a mainstream off-policy reinforcement learning (RL) framework for balancing exploitation and exploration. However, two bottlenecks still limit further performance improvement: (1) non-stationar…

Reinforcement Learning OpenAI Gym

Oscillatory equilibrium in asymmetric evolutionary games: Generalizing evolutionarily stable strategy

2024-10-17 · Vikash Kumar Dubey, Suman Chakraborty, Sagar Chakraborty

The concept of evolutionarily stability and its relation with the fixed points of the replicator equation are important aspects of evolutionary game dynamics. In the light of the fact that oscillating state of a populati…

Target Entropy Annealing for Discrete Soft Actor-Critic

2021-12-06 · Yaosheng Xu, Dailin Hu, Litian Liang, Stephen Mcaleer 외

Soft Actor-Critic (SAC) is considered the state-of-the-art algorithm in continuous action space settings. It uses the maximum entropy framework for efficiency and stability, and applies a heuristic temperature Lagrange t…

Atari Games Scheduling