Scene Understanding Networks for Autonomous Driving based on Around View Monitoring System
Modern driver assistance systems rely on a wide range of sensors (RADAR, LIDAR, ultrasound and cameras) for scene understanding and prediction. These sensors are typically used for detecting traffic participants and scene elements required for navigation. In this paper we argue that relying on camera based systems, specifically Around View Monitoring (AVM) system has great potential to achieve these goals in both parking and driving modes with decreased costs. The contributions of this paper are as follows: we present a new end-to-end solution for delimiting the safe drivable area for each frame by means of identifying the closest obstacle in each direction from the driving vehicle, we use this approach to calculate the distance to the nearest obstacles and we incorporate it into a unified end-to-end architecture capable of joint object detection, curb detection and safe drivable area detection. Furthermore, we describe the family of networks for both a high accuracy solution and a low complexity solution. We also introduce further augmentation of the base architecture with 3D object detection.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Object DetectionAutonomous DrivingDrivable Area Detectionobject-detectionObject DetectionScene UnderstandingSimilar Papers 제목 키워드 기반
Stag-1: Towards Realistic 4D Driving Simulation with Video Generation Model
4D driving simulation is essential for developing realistic autonomous driving simulators. Despite advancements in existing methods for generating driving scenes, significant challenges remain in view transformation and …
Autonomous DrivingAutonomous VehiclesScene UnderstandingVideo GenerationLMAD: Integrated End-to-End Vision-Language Model for Explainable Autonomous Driving
Large vision-language models (VLMs) have shown promising capabilities in scene understanding, enhancing the explainability of driving behaviors and interactivity with users. Existing methods primarily fine-tune VLMs on o…
Scene UnderstandingAutonomous DrivingScene RecognitionPredicting the Road Ahead: A Knowledge Graph based Foundation Model for Scene Understanding in Autonomous Driving
The autonomous driving field has seen remarkable advancements in various topics, such as object recognition, trajectory prediction, and motion planning. However, current approaches face limitations in effectively compreh…
Autonomous DrivingKnowledge GraphsMotion PlanningObject Recognition+2BEV-VAE: Multi-view Image Generation with Spatial Consistency for Autonomous Driving
Multi-view image generation in autonomous driving demands consistent 3D scene understanding across camera views. Most existing methods treat this problem as a 2D image set generation task, lacking explicit 3D modeling. H…
Scene UnderstandingAutonomous DrivingScene GenerationImage GenerationSGDrive: Scene-to-Goal Hierarchical World Cognition for Autonomous Driving
Recent end-to-end autonomous driving approaches have leveraged Vision-Language Models (VLMs) to enhance planning capabilities in complex driving scenarios. However, VLMs are inherently trained as generalist models, lacki…
Representation LearningTrajectory PlanningAutonomous Driving