MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Querying
Motion prediction is crucial for autonomous driving systems to understand complex driving scenarios and make informed decisions. However, this task is challenging due to the diverse behaviors of traffic participants and complex environmental contexts. In this paper, we propose Motion TRansformer (MTR) frameworks to address these challenges. The initial MTR framework utilizes a transformer encoder-decoder structure with learnable intention queries, enabling efficient and accurate prediction of future trajectories. By customizing intention queries for distinct motion modalities, MTR improves multimodal motion prediction while reducing reliance on dense goal candidates. The framework comprises two essential processes: global intention localization, identifying the agent's intent to enhance overall efficiency, and local movement refinement, adaptively refining predicted trajectories for improved accuracy. Moreover, we introduce an advanced MTR++ framework, extending the capability of MTR to simultaneously predict multimodal motion for multiple agents. MTR++ incorporates symmetric context modeling and mutually-guided intention querying modules to facilitate future behavior interaction among multiple agents, resulting in scene-compliant future trajectories. Extensive experimental results demonstrate that the MTR framework achieves state-of-the-art performance on the highly-competitive motion prediction benchmarks, while the MTR++ framework surpasses its precursor, exhibiting enhanced performance and efficiency in predicting accurate multimodal future trajectories for multiple agents.
Code (1)
Tasks
Autonomous DrivingDecodermotion predictionPredictionSimilar Papers 제목 키워드 기반
HiVT: Hierarchical Vector Transformer for Multi-Agent Motion Prediction
Accurately predicting the future motions of surrounding traffic agents is critical for the safety of autonomous vehicles. Recently, vectorized approaches have dominated the motion prediction community due to their ca…
Autonomous DrivingAutonomous VehiclesMotion Forecastingmotion prediction+3SIMPL: A Simple and Efficient Multi-agent Motion Prediction Baseline for Autonomous Driving
This paper presents a Simple and effIcient Motion Prediction baseLine (SIMPL) for autonomous vehicles. Unlike conventional agent-centric methods with high accuracy but repetitive computations and scene-centric methods wi…
Autonomous DrivingAutonomous VehiclesMotion Forecastingmotion predictionSIMMF: Semantics-aware Interactive Multiagent Motion Forecasting for Autonomous Vehicle Driving
Autonomous vehicles require motion forecasting of their surrounding multiagents (pedestrians and vehicles) to make optimal decisions for navigation. The existing methods focus on techniques to utilize the positions and v…
Autonomous DrivingAutonomous VehiclesMotion Forecastingmotion predictionTrajectory Prediction for Autonomous Driving based on Multi-Head Attention with Joint Agent-Map Representation
Predicting the trajectories of surrounding agents is an essential ability for autonomous vehicles navigating through complex traffic scenes. The future trajectories of agents can be inferred using two important cues: the…
Autonomous DrivingAutonomous VehiclesTrajectory PredictionSceneMotion: From Agent-Centric Embeddings to Scene-Wide Forecasts
Self-driving vehicles rely on multimodal motion forecasts to effectively interact with their environment and plan safe maneuvers. We introduce SceneMotion, an attention-based model for forecasting scene-wide motion modes…