Disentangling and Vectorization: A 3D Visual Perception Approach for Autonomous Driving Based on Surround-View Fisheye Cameras
The 3D visual perception for vehicles with the surround-view fisheye camera system is a critical and challenging task for low-cost urban autonomous driving. While existing monocular 3D object detection methods perform not well enough on the fisheye images for mass production, partly due to the lack of 3D datasets of such images. In this paper, we manage to overcome and avoid the difficulty of acquiring the large scale of accurate 3D labeled truth data, by breaking down the 3D object detection task into some sub-tasks, such as vehicle's contact point detection, type classification, re-identification and unit assembling, etc. Particularly, we propose the concept of Multidimensional Vector to include the utilizable information generated in different dimensions and stages, instead of the descriptive approach for the bird's eye view (BEV) or a cube of eight points. The experiments of real fisheye images demonstrate that our solution achieves state-of-the-art accuracy while being real-time in practice.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Object DetectionAutonomous DrivingDescriptiveMonocular 3D Object Detectionobject-detectionObject DetectionSimilar Papers 제목 키워드 기반
Online Map Vectorization for Autonomous Driving: A Rasterization Perspective
Vectorized high-definition (HD) map is essential for autonomous driving, providing detailed and precise environmental information for advanced perception and planning. However, current map vectorization methods often exh…
Autonomous DrivingPhilosophySensitivityHuman-vehicle Cooperative Visual Perception for Autonomous Driving under Complex Road and Traffic Scenarios
Human-vehicle cooperative driving has become the critical technology of autonomous driving, which reduces the workload of human drivers. However, the complex and uncertain road environments bring great challenges to the …
Autonomous DrivingAutonomous Vehiclesobject-detectionObject Detection+1Visual Exemplar Driven Task-Prompting for Unified Perception in Autonomous Driving
Multi-task learning has emerged as a powerful paradigm to solve a range of tasks simultaneously with good efficiency in both computation resources and inference time. However, these algorithms are designed for different …
Autonomous DrivingLane DetectionMulti-Task Learningobject-detection+2Visual Perception System for Autonomous Driving
The recent surge in interest in autonomous driving stems from its rapidly developing capacity to enhance safety, efficiency, and convenience. A pivotal aspect of autonomous driving technology is its perceptual systems, w…
Autonomous DrivingCamera Localizationobject-detectionObject Detection+2A Benchmark for Vision-Centric HD Mapping by V2I Systems
Autonomous driving faces safety challenges due to a lack of global perspective and the semantic information of vectorized high-definition (HD) maps. Information from roadside cameras can greatly expand the map perception…
Autonomous DrivingAutonomous Vehicles