paper-with-me

Papers

Kinematics-Aware Latent World Models for Data-Efficient Autonomous Driving

2026-03-07 · Jiazhuo Li, Linjiang Cao, Qi Liu, Xi Xiong arxiv

Data-efficient learning remains a central challenge in autonomous driving due to the high cost and safety risks of large-scale real-world interaction. Although world-model-based reinforcement learning enables policy optimization through latent imagination, existing approaches often lack explicit mechanisms to encode spatial and kinematic structure essential for driving tasks. In this work, we build upon the Recurrent State-Space Model (RSSM) and propose a kinematics-aware latent world model framework for autonomous driving. Vehicle kinematic information is incorporated into the observation encoder to ground latent transitions in physically meaningful motion dynamics, while geometry-aware supervision regularizes the RSSM latent state to capture task-relevant spatial structure beyond pixel reconstruction. The resulting structured latent dynamics improve long-horizon imagination fidelity and stabilize policy optimization. Experiments in a driving simulation benchmark demonstrate consistent gains over both model-free and pixel-based world-model baselines in terms of sample efficiency and driving performance. Ablation studies further verify that the proposed design enhances spatial representation quality within the latent space. These results suggest that integrating kinematic grounding into RSSM-based world models provides a scalable and physically grounded paradigm for autonomous driving policy learning.

📄 PDF Abstract BibTeX arXiv:2603.07264

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningAutonomous Driving

Similar Papers 제목 키워드 기반

Kinematics-aware Trajectory Generation and Prediction with Latent Stochastic Differential Modeling

2023-09-17 · Ruochen Jiao, YiXuan Wang, Xiangguo Liu, Chao Huang 외

Trajectory generation and trajectory prediction are two critical tasks in autonomous driving, which generate various trajectories for testing during development and predict the trajectories of surrounding vehicles during…

Autonomous DrivingAutonomous VehiclesTrajectory Prediction

Hierarchical Diffusion Policy for Kinematics-Aware Multi-Task Robotic Manipulation

2024-03-06 · CVPR 2024 1 · Xiao Ma, Sumit Patidar, Iain Haughton, Stephen James

This paper introduces Hierarchical Diffusion Policy (HDP), a hierarchical agent for multi-task robotic manipulation. HDP factorises a manipulation policy into a hierarchical structure: a high-level task-planning agent wh…

PositionTask Planning

LAP: Fast LAtent Diffusion Planner for Autonomous Driving

2025-11-29 · Jinhao Zhang, Wenlong Xia, Zhexuan Zhou, Haoming Song 외 arxiv

Diffusion models have demonstrated strong capabilities for modeling human-like driving behaviors in autonomous driving, but their iterative sampling process induces substantial latency, and operating directly on raw traj…

Autonomous Driving

World-Coordinate Human Motion Retargeting via SAM 3D Body

2025-12-25 · Zhangzheng Tu, Kailun Su, Shaolong Zhu, Yukun Zheng arxiv

Recovering world-coordinate human motion from monocular videos with humanoid robot retargeting is significant for embodied intelligence and robotics. To avoid complex SLAM pipelines or heavy temporal models, we propose a…

DriveFuture: Future-Aware Latent World Models for Autonomous Driving

2026-05-10 · Yufeng Hong, Xiaotian Zhou, Yingyan Li, Xiangpo Zhou 외 arxiv

Existing latent world models for autonomous driving have opened a promising path toward future-aware driving intelligence. However, they typically treat future latent states as prediction targets or auxiliary signals, ra…

Trajectory PlanningAutonomous Driving