PointPillars: Fast Encoders for Object Detection from Point Clouds
Object detection in point clouds is an important aspect of many robotics applications such as autonomous driving. In this paper we consider the problem of encoding a point cloud into a format appropriate for a downstream detection pipeline. Recent literature suggests two types of encoders; fixed encoders tend to be fast but sacrifice accuracy, while encoders that are learned from data are more accurate, but slower. In this work we propose PointPillars, a novel encoder which utilizes PointNets to learn a representation of point clouds organized in vertical columns (pillars). While the encoded features can be used with any standard 2D convolutional detection architecture, we further propose a lean downstream network. Extensive experimentation shows that PointPillars outperforms previous encoders with respect to both speed and accuracy by a large margin. Despite only using lidar, our full detection pipeline significantly outperforms the state of the art, even among fusion methods, with respect to both the 3D and bird's eye view KITTI benchmarks. This detection performance is achieved while running at 62 Hz: a 2 - 4 fold runtime improvement. A faster version of our method matches the state of the art at 105 Hz. These benchmarks suggest that PointPillars is an appropriate encoding for object detection in point clouds.
Code (18)
Tasks
3D Object DetectionAutonomous DrivingBirds Eye View Object DetectionObjectobject-detectionObject DetectionRobust 3D Object DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
PointPillars Backbone Type Selection For Fast and Accurate LiDAR Object Detection
3D object detection from LiDAR sensor data is an important topic in the context of autonomous cars and drones. In this paper, we present the results of experiments on the impact of backbone selection of a deep convolutio…
3D Object Detectionobject-detectionObject DetectionVocal Bursts Type Prediction3DPillars: Pillar-based two-stage 3D object detection
PointPillars is the fastest 3D object detector that exploits pseudo image representations to encode features for 3D objects in a scene. Albeit efficient, PointPillars is typically outperformed by state-of-the-art 3D dete…
3D Object DetectionFrustum-PointPillars: A Multi-Stage Approach for 3D Object Detection using RGB Camera and LiDAR
Accurate 3D object detection is a key part of the perception module for autonomous vehicles. A better understanding of the objects in 3D facilitates better decision-making and path planning. RGB Cameras and LiDAR are the…
2D Object Detection3D Object DetectionAutonomous VehiclesBirds Eye View Object Detection+5SS3D: Single Shot 3D Object Detector
Single stage deep learning algorithm for 2D object detection was made popular by Single Shot MultiBox Detector (SSD) and it was heavily adopted in several embedded applications. PointPillars is a state of the art 3D obje…
2D Object Detection3D Object DetectionObjectobject-detection+2Study of Dropout in PointPillars with 3D Object Detection
3D object detection is critical for autonomous driving, leveraging deep learning techniques to interpret LiDAR data. The PointPillars architecture is a prominent model in this field, distinguished by its efficient use of…
3D Object DetectionAutonomous Drivingobject-detectionObject Detection