paper-with-me

홈 › Papers

Streaming Motion Forecasting for Autonomous Driving

2023-10-02 · Ziqi Pang, Deva Ramanan, Mengtian Li, Yu-Xiong Wang

Trajectory forecasting is a widely-studied problem for autonomous navigation. However, existing benchmarks evaluate forecasting based on independent snapshots of trajectories, which are not representative of real-world applications that operate on a continuous stream of data. To bridge this gap, we introduce a benchmark that continuously queries future trajectories on streaming data and we refer to it as "streaming forecasting." Our benchmark inherently captures the disappearance and re-appearance of agents, presenting the emergent challenge of forecasting for occluded agents, which is a safety-critical problem yet overlooked by snapshot-based benchmarks. Moreover, forecasting in the context of continuous timestamps naturally asks for temporal coherence between predictions from adjacent timestamps. Based on this benchmark, we further provide solutions and analysis for streaming forecasting. We propose a plug-and-play meta-algorithm called "Predictive Streamer" that can adapt any snapshot-based forecaster into a streaming forecaster. Our algorithm estimates the states of occluded agents by propagating their positions with multi-modal trajectories, and leverages differentiable filters to ensure temporal consistency. Both occlusion reasoning and temporal coherence strategies significantly improve forecasting quality, resulting in 25% smaller endpoint errors for occluded agents and 10-20% smaller fluctuations of trajectories. Our work is intended to generate interest within the community by highlighting the importance of addressing motion forecasting in its intrinsic streaming setting. Code is available at https://github.com/ziqipang/StreamingForecasting.

📄 PDF Abstract BibTeX arXiv:2310.01351

Code (1)

ziqipang/streamingforecasting 공식 구현 pytorch

Tasks

Autonomous DrivingAutonomous NavigationMotion ForecastingTrajectory Forecasting

Similar Papers 제목 키워드 기반

Are We Ready for Vision-Centric Driving Streaming Perception? The ASAP Benchmark

2022-12-17 · CVPR 2023 1 · XiaoFeng Wang, Zheng Zhu, Yunpeng Zhang, Guan Huang 외

In recent years, vision-centric perception has flourished in various autonomous driving tasks, including 3D detection, semantic map construction, motion forecasting, and depth estimation. Nevertheless, the latency of vis…

Autonomous DrivingDepth EstimationMotion Forecasting

PanguMotion: Continuous Driving Motion Forecasting with Pangu Transformers

2026-03-17 · Quanhao Ren, Yicheng Li, Nan Song arxiv

Motion forecasting is a core task in autonomous driving systems, aiming to accurately predict the future trajectories of surrounding agents to ensure driving safety. Existing methods typically process discrete driving sc…

Autonomous DrivingMotion Forecasting

DAMO-StreamNet: Optimizing Streaming Perception in Autonomous Driving

2023-03-30 · Jun-Yan He, Zhi-Qi Cheng, Chenyang Li, Wangmeng Xiang 외

Real-time perception, or streaming perception, is a crucial aspect of autonomous driving that has yet to be thoroughly explored in existing research. To address this gap, we present DAMO-StreamNet, an optimized framework…

Autonomous Driving

EqDrive: Efficient Equivariant Motion Forecasting with Multi-Modality for Autonomous Driving

2023-10-26 · Yuping Wang, Jier Chen

Forecasting vehicular motions in autonomous driving requires a deep understanding of agent interactions and the preservation of motion equivariance under Euclidean geometric transformations. Traditional models often lack…

Autonomous DrivingAutonomous VehiclesMotion ForecastingPrediction

QCNeXt: A Next-Generation Framework For Joint Multi-Agent Trajectory Prediction

2023-06-18 · Zikang Zhou, Zihao Wen, JianPing Wang, Yung-Hui Li 외

Estimating the joint distribution of on-road agents' future trajectories is essential for autonomous driving. In this technical report, we propose a next-generation framework for joint multi-agent trajectory prediction c…

Autonomous DrivingDecoderMotion ForecastingPrediction+2