paper-with-me

홈 › Papers

BEVSpread: Spread Voxel Pooling for Bird's-Eye-View Representation in Vision-based Roadside 3D Object Detection

2024-06-13 · CVPR 2024 1 · Wenjie Wang, Yehao Lu, Guangcong Zheng, Shuigen Zhan, Xiaoqing Ye, Zichang Tan, Jingdong Wang, Gaoang Wang, Xi Li

Vision-based roadside 3D object detection has attracted rising attention in autonomous driving domain, since it encompasses inherent advantages in reducing blind spots and expanding perception range. While previous work mainly focuses on accurately estimating depth or height for 2D-to-3D mapping, ignoring the position approximation error in the voxel pooling process. Inspired by this insight, we propose a novel voxel pooling strategy to reduce such error, dubbed BEVSpread. Specifically, instead of bringing the image features contained in a frustum point to a single BEV grid, BEVSpread considers each frustum point as a source and spreads the image features to the surrounding BEV grids with adaptive weights. To achieve superior propagation performance, a specific weight function is designed to dynamically control the decay speed of the weights according to distance and depth. Aided by customized CUDA parallel acceleration, BEVSpread achieves comparable inference time as the original voxel pooling. Extensive experiments on two large-scale roadside benchmarks demonstrate that, as a plug-in, BEVSpread can significantly improve the performance of existing frustum-based BEV methods by a large margin of (1.12, 5.26, 3.01) AP in vehicle, pedestrian and cyclist.

📄 PDF Abstract BibTeX arXiv:2406.08785

Code (1)

datongjie/bevspread 공식 구현 pytorch

Tasks

3D Object DetectionAutonomous Drivingobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

PVAFN: Point-Voxel Attention Fusion Network with Multi-Pooling Enhancing for 3D Object Detection

2024-08-26 · Yidi Li, Jiahao Wen, Bin Ren, Wenhao Li 외

The integration of point and voxel representations is becoming more common in LiDAR-based 3D object detection. However, this combination often struggles with capturing semantic information effectively. Moreover, relying …

3D Object DetectionObjectobject-detectionObject Detection

Voxel R-CNN: Towards High Performance Voxel-based 3D Object Detection

2020-12-31 · Jiajun Deng, Shaoshuai Shi, Peiwei Li, Wengang Zhou 외

Recent advances on 3D object detection heavily rely on how the 3D data are represented, \emph{i.e.}, voxel-based or point-based representation. Many existing high performance 3D detectors are point-based because this str…

3D Object DetectionGPUobject-detectionObject Detection+2

Fusing Bird View LIDAR Point Cloud and Front View Camera Image for Deep Object Detection

2017-11-17 · Zining Wang, Wei Zhan, Masayoshi Tomizuka

We propose a new method for fusing a LIDAR point cloud and camera-captured images in the deep convolutional neural network (CNN). The proposed method constructs a new layer called non-homogeneous pooling layer to transfo…

3D Object DetectionAutonomous DrivingObjectobject-detection+1

From Multi-View to Hollow-3D: Hallucinated Hollow-3D R-CNN for 3D Object Detection

2021-07-30 · Jiajun Deng, Wengang Zhou, Yanyong Zhang, Houqiang Li

As an emerging data modal with precise distance sensing, LiDAR point clouds have been placed great expectations on 3D scene understanding. However, point clouds are always sparsely distributed in the 3D space, and with u…

3D Object Detectionobject-detectionObject DetectionScene Understanding

3D Siamese Voxel-to-BEV Tracker for Sparse Point Clouds

2021-11-08 · NeurIPS 2021 12 · Le Hui, Lingpeng Wang, Mingmei Cheng, Jin Xie 외

3D object tracking in point clouds is still a challenging problem due to the sparsity of LiDAR points in dynamic environments. In this work, we propose a Siamese voxel-to-BEV tracker, which can significantly improve the …

3D Object TrackingObject Tracking