Trajectory Prediction for Autonomous Driving based on Multi-Head Attention with Joint Agent-Map Representation
Predicting the trajectories of surrounding agents is an essential ability for autonomous vehicles navigating through complex traffic scenes. The future trajectories of agents can be inferred using two important cues: the locations and past motion of agents, and the static scene structure. Due to the high variability in scene structure and agent configurations, prior work has employed the attention mechanism, applied separately to the scene and agent configuration to learn the most salient parts of both cues. However, the two cues are tightly linked. The agent configuration can inform what part of the scene is most relevant to prediction. The static scene in turn can help determine the relative influence of agents on each other's motion. Moreover, the distribution of future trajectories is multimodal, with modes corresponding to the agent's intent. The agent's intent also informs what part of the scene and agent configuration is relevant to prediction. We thus propose a novel approach applying multi-head attention by considering a joint representation of the static scene and surrounding agents. We use each attention head to generate a distinct future trajectory to address multimodality of future trajectories. Our model achieves state of the art results on the nuScenes prediction benchmark and generates diverse future trajectories compliant with scene structure and agent configuration.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingAutonomous VehiclesTrajectory PredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Trajectory Prediction in Autonomous Driving with a Lane Heading Auxiliary Loss
Predicting a vehicle's trajectory is an essential ability for autonomous vehicles navigating through complex urban traffic scenes. Bird's-eye-view roadmap information provides valuable information for making trajectory p…
Autonomous DrivingAutonomous VehiclesPredictionTrajectory PredictionMFTraj: Map-Free, Behavior-Driven Trajectory Prediction for Autonomous Driving
This paper introduces a trajectory prediction model tailored for autonomous driving, focusing on capturing complex interactions in dynamic traffic scenarios without reliance on high-definition maps. The model, termed MFT…
Autonomous DrivingComputational EfficiencyTrajectory PredictionMulti-scale Temporal Fusion Transformer for Incomplete Vehicle Trajectory Prediction
Motion prediction plays an essential role in autonomous driving systems, enabling autonomous vehicles to achieve more accurate local-path planning and driving decisions based on predictions of the surrounding vehicles. H…
Autonomous DrivingAutonomous VehiclesMissing Valuesmotion prediction+2MSTF: Multiscale Transformer for Incomplete Trajectory Prediction
Motion forecasting plays a pivotal role in autonomous driving systems, enabling vehicles to execute collision warnings and rational local-path planning based on predictions of the surrounding vehicles. However, prevalent…
Autonomous DrivingMissing ValuesMotion ForecastingPrediction+1GaussianFusion: Gaussian-Based Multi-Sensor Fusion for End-to-End Autonomous Driving
Multi-sensor fusion is crucial for improving the performance and robustness of end-to-end autonomous driving systems. Existing methods predominantly adopt either attention-based flatten fusion or bird's eye view fusion t…
Autonomous DrivingBench2DriveNavSimSensor Fusion+1