Fusing Bird View LIDAR Point Cloud and Front View Camera Image for Deep Object Detection

2017-11-17 · Zining Wang, Wei Zhan, Masayoshi Tomizuka

We propose a new method for fusing a LIDAR point cloud and camera-captured images in the deep convolutional neural network (CNN). The proposed method constructs a new layer called non-homogeneous pooling layer to transform features between bird view map and front view map. The sparse LIDAR point cloud is used to construct the mapping between the two maps. The pooling layer allows efficient fusion of the bird view and front view features at any stage of the network. This is favorable for the 3D-object detection using camera-LIDAR fusion in autonomous driving scenarios. A corresponding deep CNN is designed and tested on the KITTI bird view object detection dataset, which produces 3D bounding boxes from the bird view map. The fusion method shows particular benefit for detection of pedestrians in the bird view compared to other fusion-based object detection networks.

📄 PDF Abstract BibTeX arXiv:1711.06703

Code (0)

등록된 구현이 없습니다.

Tasks

3D Object Detection Autonomous DrivingObjectobject-detection Object Detection

SemanticBEVFusion: Rethink LiDAR-Camera Fusion in Unified Bird's-Eye View Representation for 3D Object Detection

2022-12-09 · Qi Jiang, Hao Sun, Xi Zhang

LiDAR and camera are two essential sensors for 3D object detection in autonomous driving. LiDAR provides accurate and reliable 3D geometry information while the camera provides rich texture with color. Despite the increa…

3D geometry 3D Object Detection Autonomous Driving object-detection+1

Fully Convolutional One-Stage 3D Object Detection on LiDAR Range Images

2022-05-27 · Zhi Tian, Xiangxiang Chu, Xiaoming Wang, Xiaolin Wei 외

We present a simple yet effective fully convolutional one-stage 3D object detector for LiDAR point clouds of autonomous driving scenes, termed FCOS-LiDAR. Unlike the dominant methods that use the bird-eye view (BEV), our…

3D Object Detection Autonomous Driving object-detection Object Detection+1

Domain Adaptation for Vehicle Detection from Bird's Eye View LiDAR Point Cloud Data

2019-05-22 · Khaled Saleh, Ahmed Abobakr, Mohammed Attia, Julie Iskander 외

Point cloud data from 3D LiDAR sensors are one of the most crucial sensor modalities for versatile safety-critical applications such as self-driving vehicles. Since the annotations of point cloud data is an expensive and…

Domain Adaptation Unsupervised Domain Adaptation vehicle detection

SemanticVoxels: Sequential Fusion for 3D Pedestrian Detection using LiDAR Point Cloud and Semantic Segmentation

2020-09-25 · Juncong Fei, Wenbo Chen, Philipp Heidenreich, Sascha Wirges 외

3D pedestrian detection is a challenging task in automated driving because pedestrians are relatively small, frequently occluded and easily confused with narrow vertical objects. LiDAR and camera are two commonly used se…

Pedestrian Detection Semantic Segmentation

Road Segmentation on low resolution Lidar point clouds for autonomous vehicles

2020-05-27 · Leonardo Gigli, B Ravi Kiran, Thomas Paul, Andres Serna 외

Point cloud datasets for perception tasks in the context of autonomous driving often rely on high resolution 64-layer Light Detection and Ranging (LIDAR) scanners. They are expensive to deploy on real-world autonomous dr…

Autonomous Driving Autonomous Vehicles Road Segmentation Segmentation