Allo-centric Occupancy Grid Prediction for Urban Traffic Scene Using Video Prediction Networks
Prediction of dynamic environment is crucial to safe navigation of an autonomous vehicle. Urban traffic scenes are particularly challenging to forecast due to complex interactions between various dynamic agents, such as vehicles and vulnerable road users. Previous approaches have used egocentric occupancy grid maps to represent and predict dynamic environments. However, these predictions suffer from blurriness, loss of scene structure at turns, and vanishing of agents over longer prediction horizon. In this work, we propose a novel framework to make long-term predictions by representing the traffic scene in a fixed frame, referred as allo-centric occupancy grid. This allows for the static scene to remain fixed and to represent motion of the ego-vehicle on the grid like other agents'. We study the allo-centric grid prediction with different video prediction networks and validate the approach on the real-world Nuscenes dataset. The results demonstrate that the allo-centric grid representation significantly improves scene prediction, in comparison to the conventional ego-centric grid approach.
Code (0)
등록된 구현이 없습니다.
Tasks
PredictionVideo PredictionSimilar Papers 제목 키워드 기반
StopNet: Scalable Trajectory and Occupancy Prediction for Urban Autonomous Driving
We introduce a motion forecasting (behavior prediction) method that meets the latency requirements for autonomous driving in dense urban environments without sacrificing accuracy. A whole-scene sparse input representatio…
Autonomous DrivingMotion ForecastingAdaOcc: Adaptive-Resolution Occupancy Prediction
Autonomous driving in complex urban scenarios requires 3D perception to be both comprehensive and precise. Traditional 3D perception methods focus on object detection, resulting in sparse representations that lack enviro…
3D Reconstruction3D Semantic Occupancy PredictionAutonomous Drivingobject-detection+2Grid-Centric Traffic Scenario Perception for Autonomous Driving: A Comprehensive Review
Grid-centric perception is a crucial field for mobile robot perception and navigation. Nonetheless, grid-centric perception is less prevalent than object-centric perception as autonomous vehicles need to accurately perce…
Autonomous DrivingAutonomous VehiclesSensor FusionDynamic Environment Prediction in Urban Scenes using Recurrent Representation Learning
A key challenge for autonomous driving is safe trajectory planning in cluttered, urban environments with dynamic obstacles, such as pedestrians, bicyclists, and other vehicles. A reliable prediction of the future environ…
Autonomous DrivingRepresentation LearningCubeletWorld: A New Abstraction for Scalable 3D Modeling
Modern cities produce vast streams of heterogeneous data, from infrastructure maps to mobility logs and satellite imagery. However, integrating these sources into coherent spatial models for planning and prediction remai…