paper-with-me

Papers

SceneMotion: From Agent-Centric Embeddings to Scene-Wide Forecasts

2024-08-02 · Royden Wagner, Ömer Sahin Tas, Marlon Steiner, Fabian Konstantinidis, Hendrik Königshof, Marvin Klemp, Carlos Fernandez, Christoph Stiller

Self-driving vehicles rely on multimodal motion forecasts to effectively interact with their environment and plan safe maneuvers. We introduce SceneMotion, an attention-based model for forecasting scene-wide motion modes of multiple traffic agents. Our model transforms local agent-centric embeddings into scene-wide forecasts using a novel latent context module. This module learns a scene-wide latent space from multiple agent-centric embeddings, enabling joint forecasting and interaction modeling. The competitive performance in the Waymo Open Interaction Prediction Challenge demonstrates the effectiveness of our approach. Moreover, we cluster future waypoints in time and space to quantify the interaction between agents. We merge all modes and analyze each mode independently to determine which clusters are resolved through interaction or result in conflict. Our implementation is available at: https://github.com/kit-mrt/future-motion

📄 PDF Abstract BibTeX arXiv:2408.01537

Code (1)

kit-mrt/future-motion 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Narrowing the Coordinate-frame Gap in Behavior Prediction Models: Distillation for Efficient and Accurate Scene-centric Motion Forecasting

2022-06-08 · DiJia Su, Bertrand Douillard, Rami Al-Rfou, Cheolho Park 외

Behavior prediction models have proliferated in recent years, especially in the popular real-world robotics application of autonomous driving, where representing the distribution over possible futures of moving agents is…

Autonomous DrivingKnowledge DistillationMotion ForecastingMotion Planning+1

ProphNet: Efficient Agent-Centric Motion Forecasting with Anchor-Informed Proposals

2023-03-21 · CVPR 2023 1 · Xishun Wang, Tong Su, Fang Da, Xiaodong Yang

Motion forecasting is a key module in an autonomous driving system. Due to the heterogeneous nature of multi-sourced input, multimodality in agent behavior, and low latency required by onboard deployment, this task is no…

Autonomous DrivingMotion Forecastingmotion predictionPrediction

GLASS: Guided Latent Slot Diffusion for Object-Centric Learning

2025-01-01 · CVPR 2025 1 · Krishnakant Singh, Simone Schaub-Meyer, Stefan Roth

Object-centric learning aims to decompose an input image into a set of meaningful object files (slots). These latent object representations enable a variety of downstream tasks. Yet, object-centric learning struggles…

Conditional Image GenerationImage GenerationObjectObject Discovery

Grounding 3D Scene Affordance From Egocentric Interactions

2024-09-29 · Cuiyu Liu, Wei Zhai, Yuhang Yang, Hongchen Luo 외

Grounding 3D scene affordance aims to locate interactive regions in 3D environments, which is crucial for embodied agents to interact intelligently with their surroundings. Most existing approaches achieve this by mappin…

Allo-centric Occupancy Grid Prediction for Urban Traffic Scene Using Video Prediction Networks

2023-01-11 · Rabbia Asghar, Lukas Rummelhard, Anne Spalanzani, Christian Laugier

Prediction of dynamic environment is crucial to safe navigation of an autonomous vehicle. Urban traffic scenes are particularly challenging to forecast due to complex interactions between various dynamic agents, such as …

PredictionVideo Prediction