Far3D: Expanding the Horizon for Surround-view 3D Object Detection
Recently 3D object detection from surround-view images has made notable advancements with its low deployment cost. However, most works have primarily focused on close perception range while leaving long-range detection less explored. Expanding existing methods directly to cover long distances poses challenges such as heavy computation costs and unstable convergence. To address these limitations, this paper proposes a novel sparse query-based framework, dubbed Far3D. By utilizing high-quality 2D object priors, we generate 3D adaptive queries that complement the 3D global queries. To efficiently capture discriminative features across different views and scales for long-range objects, we introduce a perspective-aware aggregation module. Additionally, we propose a range-modulated 3D denoising approach to address query error propagation and mitigate convergence issues in long-range tasks. Significantly, Far3D demonstrates SoTA performance on the challenging Argoverse 2 dataset, covering a wide range of 150 meters, surpassing several LiDAR-based approaches. Meanwhile, Far3D exhibits superior performance compared to previous methods on the nuScenes dataset. The code is available at https://github.com/megvii-research/Far3D.
Code (1)
Tasks
3D Object DetectionDenoisingobject-detectionObject DetectionSimilar Papers 제목 키워드 기반
Sparse4D-Radar: An Efficient and Robust Framework for Surround-View 3D Object Detection via 4D Radar-Camera Fusion
In recent years, 4D imaging radar has gained wide attention in autonomous driving for its robustness against harsh weather and ability to output target velocity. Nevertheless, mainstream 4D radar-camera fusion methods on…
3D Object DetectionAutonomous DrivingARPOV: Expanding Visualization of Object Detection in AR with Panoramic Mosaic Stitching
As the uses of augmented reality (AR) become more complex and widely available, AR applications will increasingly incorporate intelligent features that require developers to understand the user's behavior and surrounding…
Objectobject-detectionObject DetectionFisheyeDetNet: 360° Surround view Fisheye Camera based Object Detection System for Autonomous Driving
Object detection is a mature problem in autonomous driving with pedestrian detection being one of the first deployed algorithms. It has been comprehensively studied in the literature. However, object detection is relativ…
ARCAutonomous DrivingInstance SegmentationObject+4STS: Surround-view Temporal Stereo for Multi-view 3D Detection
Learning accurate depth is essential to multi-view 3D object detection. Recent approaches mainly learn depth from monocular images, which confront inherent difficulties due to the ill-posed nature of monocular depth lear…
3D Object DetectionDepth EstimationDepth Predictionobject-detection+3Expanding Object Detector's Horizon: Incremental Learning Framework for Object Detection in Videos
Over the last several years it has been shown that image-based object detectors are sensitive to the training data and often fail to generalize to examples that fall outside the original training sample domain (e.g., v…
Domain AdaptationIncremental LearningObjectobject-detection+1