paper-with-me

홈 › Papers

Fast and Efficient Transformer-based Method for Bird's Eye View Instance Prediction

2024-11-11 · Miguel Antunes-García, Luis M. Bergasa, Santiago Montiel-Marín, Rafael Barea, Fabio Sánchez-García, Ángel Llamazares

Accurate object detection and prediction are critical to ensure the safety and efficiency of self-driving architectures. Predicting object trajectories and occupancy enables autonomous vehicles to anticipate movements and make decisions with future information, increasing their adaptability and reducing the risk of accidents. Current State-Of-The-Art (SOTA) approaches often isolate the detection, tracking, and prediction stages, which can lead to significant prediction errors due to accumulated inaccuracies between stages. Recent advances have improved the feature representation of multi-camera perception systems through Bird's-Eye View (BEV) transformations, boosting the development of end-to-end systems capable of predicting environmental elements directly from vehicle sensor data. These systems, however, often suffer from high processing times and number of parameters, creating challenges for real-world deployment. To address these issues, this paper introduces a novel BEV instance prediction architecture based on a simplified paradigm that relies only on instance segmentation and flow prediction. The proposed system prioritizes speed, aiming at reduced parameter counts and inference times compared to existing SOTA architectures, thanks to the incorporation of an efficient transformer-based architecture. Furthermore, the implementation of the proposed architecture is optimized for performance improvements in PyTorch version 2.1. Code and trained models are available at https://github.com/miguelag99/Efficient-Instance-Prediction

📄 PDF Abstract BibTeX arXiv:2411.06851

Code (1)

miguelag99/efficient-instance-prediction 공식 구현 pytorch

Tasks

Autonomous VehiclesInstance Segmentationobject-detectionObject DetectionPredictionSemantic Segmentation

Similar Papers 제목 키워드 기반

FipTR: A Simple yet Effective Transformer Framework for Future Instance Prediction in Autonomous Driving

2024-04-19 · Xingtai Gui, Tengteng Huang, Haonan Shao, Haotian Yao 외

The future instance prediction from a Bird's Eye View(BEV) perspective is a vital component in autonomous driving, which involves future instance segmentation and instance motion prediction. Existing methods usually rely…

Autonomous DrivingInstance Segmentationmotion predictionPrediction+1

FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Cameras

2021-04-21 · ICCV 2021 10 · Anthony Hu, Zak Murez, Nikhil Mohan, Sofía Dudas 외

Driving requires interacting with road agents and predicting their future behaviour in order to navigate safely. We present FIERY: a probabilistic future prediction model in bird's-eye view from monocular cameras. Our mo…

Autonomous DrivingBird's-Eye View Semantic SegmentationFuture predictionInstance Segmentation+4

FastOcc: Accelerating 3D Occupancy Prediction by Fusing the 2D Bird's-Eye View and Perspective View

2024-03-05 · Jiawei Hou, Xiaoyan Li, Wenhao Guan, Gang Zhang 외

In autonomous driving, 3D occupancy prediction outputs voxel-wise status and semantic labels for more comprehensive understandings of 3D scenes compared with traditional perception tasks, such as 3D object detection and …

3D Object DetectionAutonomous Drivingobject-detectionObject Detection+2

PowerBEV: A Powerful Yet Lightweight Framework for Instance Prediction in Bird's-Eye View

2023-06-19 · Peizheng Li, Shuxiao Ding, Xieyuanli Chen, Niklas Hanselmann 외

Accurately perceiving instances and predicting their future motion are key tasks for autonomous vehicles, enabling them to navigate safely in complex urban traffic. While bird's-eye view (BEV) representations are commonp…

Autonomous DrivingAutonomous Vehiclesmotion predictionNavigate+1

Bird's-Eye-View Panoptic Segmentation Using Monocular Frontal View Images

2021-08-06 · Nikhil Gosala, Abhinav Valada

Bird's-Eye-View (BEV) maps have emerged as one of the most powerful representations for scene understanding due to their ability to provide rich spatial context while being easy to interpret and process. Such maps have f…

Depth EstimationPanoptic SegmentationScene SegmentationScene Understanding+2