paper-with-me

Papers

Implicit Occupancy Flow Fields for Perception and Prediction in Self-Driving

2023-08-02 · CVPR 2023 1 · Ben Agro, Quinlan Sykora, Sergio Casas, Raquel Urtasun

A self-driving vehicle (SDV) must be able to perceive its surroundings and predict the future behavior of other traffic participants. Existing works either perform object detection followed by trajectory forecasting of the detected objects, or predict dense occupancy and flow grids for the whole scene. The former poses a safety concern as the number of detections needs to be kept low for efficiency reasons, sacrificing object recall. The latter is computationally expensive due to the high-dimensionality of the output grid, and suffers from the limited receptive field inherent to fully convolutional networks. Furthermore, both approaches employ many computational resources predicting areas or objects that might never be queried by the motion planner. This motivates our unified approach to perception and future prediction that implicitly represents occupancy and flow over time with a single neural network. Our method avoids unnecessary computation, as it can be directly queried by the motion planner at continuous spatio-temporal locations. Moreover, we design an architecture that overcomes the limited receptive field of previous explicit occupancy prediction methods by adding an efficient yet effective global attention mechanism. Through extensive experiments in both urban and highway settings, we demonstrate that our implicit model outperforms the current state-of-the-art. For more information, visit the project website: https://waabi.ai/research/implicito.

📄 PDF Abstract BibTeX arXiv:2308.01471

Code (0)

등록된 구현이 없습니다.

Tasks

Future predictionobject-detectionObject DetectionTrajectory Forecasting

Similar Papers 제목 키워드 기반

SelfOccFlow: Towards end-to-end self-supervised 3D Occupancy Flow prediction

2026-02-27 · Xavier Timoneda, Markus Herb, Fabian Duerr, Daniel Goehring arxiv

Estimating 3D occupancy and motion at the vehicle's surroundings is essential for autonomous driving, enabling situational awareness in dynamic environments. Existing approaches jointly learn geometry and motion but rely…

Autonomous Driving

Let Occ Flow: Self-Supervised 3D Occupancy Flow Prediction

2024-07-10 · Yili Liu, Linzhan Mou, Xuan Yu, Chenrui Han 외

Accurate perception of the dynamic environment is a fundamental task for autonomous driving and robot systems. This paper introduces Let Occ Flow, the first self-supervised work for joint 3D occupancy and occupancy flow …

Autonomous DrivingOptical Flow EstimationPrediction

VectorFlow: Combining Images and Vectors for Traffic Occupancy and Flow Prediction

2022-08-09 · Xin Huang, Xiaoyu Tian, Junru Gu, Qiao Sun 외

Predicting future behaviors of road agents is a key task in autonomous driving. While existing models have demonstrated great success in predicting marginal agent future behaviors, it remains a challenge to efficiently p…

Autonomous Driving

StreamingFlow: Streaming Occupancy Forecasting with Asynchronous Multi-modal Data Streams via Neural Ordinary Differential Equation

2023-02-19 · CVPR 2024 1 · Yining Shi, Kun Jiang, Ke Wang, Jiusi Li 외

Predicting the future occupancy states of the surrounding environment is a vital task for autonomous driving. However, current best-performing single-modality methods or multi-modality fusion perception methods are only …

Autonomous DrivingSensor Fusion

Occupancy Flow Fields for Motion Forecasting in Autonomous Driving

2022-03-08 · Reza Mahjourian, Jinkyu Kim, Yuning Chai, Mingxing Tan 외

We propose Occupancy Flow Fields, a new representation for motion forecasting of multiple agents, an important task in autonomous driving. Our representation is a spatio-temporal grid with each grid cell containing both …

Autonomous DrivingMotion EstimationMotion Forecasting