paper-with-me

Papers

SimpleBEV: Improved LiDAR-Camera Fusion Architecture for 3D Object Detection

2024-11-08 · Yun Zhao, Zhan Gong, Peiru Zheng, Hong Zhu, Shaohua Wu

More and more research works fuse the LiDAR and camera information to improve the 3D object detection of the autonomous driving system. Recently, a simple yet effective fusion framework has achieved an excellent detection performance, fusing the LiDAR and camera features in a unified bird's-eye-view (BEV) space. In this paper, we propose a LiDAR-camera fusion framework, named SimpleBEV, for accurate 3D object detection, which follows the BEV-based fusion framework and improves the camera and LiDAR encoders, respectively. Specifically, we perform the camera-based depth estimation using a cascade network and rectify the depth results with the depth information derived from the LiDAR points. Meanwhile, an auxiliary branch that implements the 3D object detection using only the camera-BEV features is introduced to exploit the camera information during the training phase. Besides, we improve the LiDAR feature extractor by fusing the multi-scaled sparse convolutional features. Experimental results demonstrate the effectiveness of our proposed method. Our method achieves 77.6\% NDS accuracy on the nuScenes dataset, showcasing superior performance in the 3D object detection track.

📄 PDF Abstract BibTeX arXiv:2411.05292

Code (0)

등록된 구현이 없습니다.

Tasks

3D Object DetectionAutonomous DrivingDepth EstimationObjectobject-detectionObject Detection

Similar Papers 제목 키워드 기반

DeepFusion: A Robust and Modular 3D Object Detector for Lidars, Cameras and Radars

2022-09-26 · Florian Drews, Di Feng, Florian Faion, Lars Rosenbaum 외

We propose DeepFusion, a modular multi-modal architecture to fuse lidars, cameras and radars in different combinations for 3D object detection. Specialized feature extractors take advantage of each modality and can be ex…

3D Object DetectionDepth Estimationobject-detectionObject Detection

BEVMOSNet: Multimodal Fusion for BEV Moving Object Segmentation

2025-03-05 · Hiep Truong Cong, Ajay Kumar Sigatapu, Arindam Das, Yashwanth Sharma 외

Accurate motion understanding of the dynamic objects within the scene in bird's-eye-view (BEV) is critical to ensure a reliable obstacle avoidance system and smooth path planning for autonomous vehicles. However, this ta…

Autonomous VehiclesMotion SegmentationObjectobject-detection+4

CoBEVFusion: Cooperative Perception with LiDAR-Camera Bird's-Eye View Fusion

2023-10-09 · Donghao Qiao, Farhana Zulkernine

Autonomous Vehicles (AVs) use multiple sensors to gather information about their surroundings. By sharing sensor data between Connected Autonomous Vehicles (CAVs), the safety and reliability of these vehicles can be impr…

3D Object DetectionAutonomous Vehiclesobject-detectionObject Detection+1

Robust Bird's Eye View Segmentation by Adapting DINOv2

2024-09-16 · Merve Rabia Barın, Görkay Aydemir, Fatma Güney

Extracting a Bird's Eye View (BEV) representation from multiple camera images offers a cost-effective, scalable alternative to LIDAR-based solutions in autonomous driving. However, the performance of the existing BEV met…

Autonomous Driving

3D Dual-Fusion: Dual-Domain Dual-Query Camera-LiDAR Fusion for 3D Object Detection

2022-11-24 · Yecheol Kim, Konyul Park, Minwook Kim, Dongsuk Kum 외

Fusing data from cameras and LiDAR sensors is an essential technique to achieve robust 3D object detection. One key challenge in camera-LiDAR fusion involves mitigating the large domain gap between the two sensors in ter…

3D Object Detectionobject-detectionObject DetectionRobust 3D Object Detection