ProphNet: Efficient Agent-Centric Motion Forecasting with Anchor-Informed Proposals
Motion forecasting is a key module in an autonomous driving system. Due to the heterogeneous nature of multi-sourced input, multimodality in agent behavior, and low latency required by onboard deployment, this task is notoriously challenging. To cope with these difficulties, this paper proposes a novel agent-centric model with anchor-informed proposals for efficient multimodal motion prediction. We design a modality-agnostic strategy to concisely encode the complex input in a unified manner. We generate diverse proposals, fused with anchors bearing goal-oriented scene context, to induce multimodal prediction that covers a wide range of future trajectories. Our network architecture is highly uniform and succinct, leading to an efficient model amenable for real-world driving deployment. Experiments reveal that our agent-centric network compares favorably with the state-of-the-art methods in prediction accuracy, while achieving scene-centric level inference latency.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingMotion Forecastingmotion predictionPredictionSimilar Papers 제목 키워드 기반
Query-Centric Trajectory Prediction
Predicting the future trajectories of surrounding agents is essential for autonomous vehicles to operate safely. This paper presents QCNet, a modeling framework toward pushing the boundaries of trajectory prediction.…
Autonomous DrivingAutonomous VehiclesMotion Forecastingmotion prediction+3SceneMotion: From Agent-Centric Embeddings to Scene-Wide Forecasts
Self-driving vehicles rely on multimodal motion forecasts to effectively interact with their environment and plan safe maneuvers. We introduce SceneMotion, an attention-based model for forecasting scene-wide motion modes…
Narrowing the Coordinate-frame Gap in Behavior Prediction Models: Distillation for Efficient and Accurate Scene-centric Motion Forecasting
Behavior prediction models have proliferated in recent years, especially in the popular real-world robotics application of autonomous driving, where representing the distribution over possible futures of moving agents is…
Autonomous DrivingKnowledge DistillationMotion ForecastingMotion Planning+1Human-JEPA: A Human-Centric Vision Model that Perceives and Anticipates
Machines that understand humans should perceive the present and anticipate the future. Existing human-centric vision model are pretrained on human images, set the state of the art in static dense perception, so motion an…
Person Re-IdentificationMotionLM: Multi-Agent Motion Forecasting as Language Modeling
Reliable forecasting of the future behavior of road agents is a critical component to safe planning in autonomous vehicles. Here, we represent continuous trajectories as sequences of discrete motion tokens and cast multi…
Autonomous VehiclesLanguage ModelingLanguage ModellingMotion Forecasting+1