TransDiffuser: End-to-end Trajectory Generation with Decorrelated Multi-modal Representation for Autonomous Driving
In recent years, diffusion model has shown its potential across diverse domains from vision generation to language modeling. Transferring its capabilities to modern autonomous driving systems has also emerged as a promising direction.In this work, we propose TransDiffuser, an encoder-decoder based generative trajectory planning model for end-to-end autonomous driving. The encoded scene information serves as the multi-modal conditional input of the denoising decoder. To tackle the mode collapse dilemma in generating high-quality diverse trajectories, we introduce a simple yet effective multi-modal representation decorrelation optimization mechanism during the training process.TransDiffuser achieves PDMS of 94.85 on the NAVSIM benchmark, surpassing previous state-of-the-art methods without any anchor-based prior trajectories.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingDecoderDenoisingLanguage ModelingLanguage ModellingNavSimTrajectory PlanningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Decorrelated Double Q-learning
Q-learning with value function approximation may have the poor performance because of overestimation bias and imprecise estimate. Specifically, overestimation bias is from the maximum operator over noise estimate, which …
continuous-controlContinuous ControlDeep Reinforcement LearningMuJoCo+3Generalizable Spacecraft Trajectory Generation via Multimodal Learning with Transformers
Effective trajectory generation is essential for reliable on-board spacecraft autonomy. Among other approaches, learning-based warm-starting represents an appealing paradigm for solving the trajectory generation problem,…
K-Gen: A Multimodal Language-Conditioned Approach for Interpretable Keypoint-Guided Trajectory Generation
Generating realistic and diverse trajectories is a critical challenge in autonomous driving simulation. While Large Language Models (LLMs) show promise, existing methods often rely on structured data like vectorized maps…
Multimodal ReasoningAutonomous DrivingUniCMs: A Unified Consistency Model For Efficient Multimodal Generation and Understanding
Consistency models (CMs) have shown promise in the efficient generation of both image and text. This raises the natural question of whether we can learn a unified CM for efficient multimodal generation (e.g., text-to-ima…
DenoisingImage GenerationImage to textLanguage Modeling+5CrossTracker: Robust Multi-modal 3D Multi-Object Tracking via Cross Correction
The fusion of camera- and LiDAR-based detections offers a promising solution to mitigate tracking failures in 3D multi-object tracking (MOT). However, existing methods predominantly exploit camera detections to correct t…
3D Multi-Object TrackingMulti-Object TrackingObject Tracking