paper-with-me

Papers

Motion Transformer with Global Intention Localization and Local Movement Refinement

2022-09-27 · Shaoshuai Shi, Li Jiang, Dengxin Dai, Bernt Schiele

Predicting multimodal future behavior of traffic participants is essential for robotic vehicles to make safe decisions. Existing works explore to directly predict future trajectories based on latent features or utilize dense goal candidates to identify agent's destinations, where the former strategy converges slowly since all motion modes are derived from the same feature while the latter strategy has efficiency issue since its performance highly relies on the density of goal candidates. In this paper, we propose Motion TRansformer (MTR) framework that models motion prediction as the joint optimization of global intention localization and local movement refinement. Instead of using goal candidates, MTR incorporates spatial intention priors by adopting a small set of learnable motion query pairs. Each motion query pair takes charge of trajectory prediction and refinement for a specific motion mode, which stabilizes the training process and facilitates better multimodal predictions. Experiments show that MTR achieves state-of-the-art performance on both the marginal and joint motion prediction challenges, ranking 1st on the leaderboards of Waymo Open Motion Dataset. The source code is available at https://github.com/sshaoshuai/MTR.

📄 PDF Abstract BibTeX arXiv:2209.13508

Code (3)

sshaoshuai/mtr 공식 구현 pytorch
kit-mrt/future-motion pytorch
nikeke19/safe-mult-rl pytorch

Tasks

motion predictionPredictionTrajectory Prediction

Similar Papers 제목 키워드 기반

MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Querying

2023-06-30 · Shaoshuai Shi, Li Jiang, Dengxin Dai, Bernt Schiele

Motion prediction is crucial for autonomous driving systems to understand complex driving scenarios and make informed decisions. However, this task is challenging due to the diverse behaviors of traffic participants and …

Autonomous DrivingDecodermotion predictionPrediction

Multi-Context Fusion Transformer for Pedestrian Crossing Intention Prediction in Urban Environments

2025-11-25 · Yuanzhe Li, Hang Zhong, Steffen Müller arxiv

Pedestrian crossing intention prediction is essential for autonomous vehicles to improve pedestrian safety and reduce traffic accidents. However, accurate pedestrian intention prediction in urban environments remains cha…

Autonomous Vehicles

MTR-A: 1st Place Solution for 2022 Waymo Open Dataset Challenge -- Motion Prediction

2022-09-20 · Shaoshuai Shi, Li Jiang, Dengxin Dai, Bernt Schiele

In this report, we present the 1st place solution for motion prediction track in 2022 Waymo Open Dataset Challenges. We propose a novel Motion Transformer framework for multimodal motion prediction, which introduces a sm…

motion predictionPrediction

Control Globally, Understand Locally: A Global-to-Local Hierarchical Graph Network for Emotional Support Conversation

2022-04-27 · Wei Peng, Yue Hu, Luxi Xing, Yuqiang Xie 외

Emotional support conversation aims at reducing the emotional distress of the help-seeker, which is a new and challenging task. It requires the system to explore the cause of help-seeker's emotional distress and understa…

Decoder

ACIT: Attention-Guided Cross-Modal Interaction Transformer for Pedestrian Crossing Intention Prediction

2025-11-25 · Yuanzhe Li, Steffen Müller arxiv

Predicting pedestrian crossing intention is crucial for autonomous vehicles to prevent pedestrian-related collisions. However, effectively extracting and integrating complementary cues from different types of data remain…

Autonomous Vehicles