SceneMotion: From Agent-Centric Embeddings to Scene-Wide Forecasts
Self-driving vehicles rely on multimodal motion forecasts to effectively interact with their environment and plan safe maneuvers. We introduce SceneMotion, an attention-based model for forecasting scene-wide motion modes of multiple traffic agents. Our model transforms local agent-centric embeddings into scene-wide forecasts using a novel latent context module. This module learns a scene-wide latent space from multiple agent-centric embeddings, enabling joint forecasting and interaction modeling. The competitive performance in the Waymo Open Interaction Prediction Challenge demonstrates the effectiveness of our approach. Moreover, we cluster future waypoints in time and space to quantify the interaction between agents. We merge all modes and analyze each mode independently to determine which clusters are resolved through interaction or result in conflict. Our implementation is available at: https://github.com/kit-mrt/future-motion
Code (1)
Similar Papers 제목 키워드 기반
Narrowing the Coordinate-frame Gap in Behavior Prediction Models: Distillation for Efficient and Accurate Scene-centric Motion Forecasting
Behavior prediction models have proliferated in recent years, especially in the popular real-world robotics application of autonomous driving, where representing the distribution over possible futures of moving agents is…
Autonomous DrivingKnowledge DistillationMotion ForecastingMotion Planning+1ProphNet: Efficient Agent-Centric Motion Forecasting with Anchor-Informed Proposals
Motion forecasting is a key module in an autonomous driving system. Due to the heterogeneous nature of multi-sourced input, multimodality in agent behavior, and low latency required by onboard deployment, this task is no…
Autonomous DrivingMotion Forecastingmotion predictionPredictionGLASS: Guided Latent Slot Diffusion for Object-Centric Learning
Object-centric learning aims to decompose an input image into a set of meaningful object files (slots). These latent object representations enable a variety of downstream tasks. Yet, object-centric learning struggles…
Conditional Image GenerationImage GenerationObjectObject DiscoveryGrounding 3D Scene Affordance From Egocentric Interactions
Grounding 3D scene affordance aims to locate interactive regions in 3D environments, which is crucial for embodied agents to interact intelligently with their surroundings. Most existing approaches achieve this by mappin…
Allo-centric Occupancy Grid Prediction for Urban Traffic Scene Using Video Prediction Networks
Prediction of dynamic environment is crucial to safe navigation of an autonomous vehicle. Urban traffic scenes are particularly challenging to forecast due to complex interactions between various dynamic agents, such as …
PredictionVideo Prediction