paper-with-me

홈 › Papers

BEVHeight++: Toward Robust Visual Centric 3D Object Detection

2023-09-28 · Lei Yang, Tao Tang, Jun Li, Peng Chen, Kun Yuan, Li Wang, Yi Huang, Xinyu Zhang, Kaicheng Yu

While most recent autonomous driving system focuses on developing perception methods on ego-vehicle sensors, people tend to overlook an alternative approach to leverage intelligent roadside cameras to extend the perception ability beyond the visual range. We discover that the state-of-the-art vision-centric bird's eye view detection methods have inferior performances on roadside cameras. This is because these methods mainly focus on recovering the depth regarding the camera center, where the depth difference between the car and the ground quickly shrinks while the distance increases. In this paper, we propose a simple yet effective approach, dubbed BEVHeight++, to address this issue. In essence, we regress the height to the ground to achieve a distance-agnostic formulation to ease the optimization process of camera-only perception methods. By incorporating both height and depth encoding techniques, we achieve a more accurate and robust projection from 2D to BEV spaces. On popular 3D detection benchmarks of roadside cameras, our method surpasses all previous vision-centric methods by a significant margin. In terms of the ego-vehicle scenario, our BEVHeight++ possesses superior over depth-only methods. Specifically, it yields a notable improvement of +1.9% NDS and +1.1% mAP over BEVDepth when evaluated on the nuScenes validation set. Moreover, on the nuScenes test set, our method achieves substantial advancements, with an increase of +2.8% NDS and +1.7% mAP, respectively.

📄 PDF Abstract BibTeX arXiv:2309.16179

Code (0)

등록된 구현이 없습니다.

Tasks

3D Object DetectionAutonomous DrivingObjectobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

BEVHeight: A Robust Framework for Vision-based Roadside 3D Object Detection

2023-03-15 · CVPR 2023 1 · Lei Yang, Kaicheng Yu, Tao Tang, Jun Li 외

While most recent autonomous driving system focuses on developing perception methods on ego-vehicle sensors, people tend to overlook an alternative approach to leverage intelligent roadside cameras to extend the percepti…

3D Object DetectionAutonomous Drivingobject-detectionObject Detection

SGV3D:Towards Scenario Generalization for Vision-based Roadside 3D Object Detection

2024-01-29 · Lei Yang, Xinyu Zhang, Jun Li, Li Wang 외

Roadside perception can greatly increase the safety of autonomous vehicles by extending their perception ability beyond the visual range and addressing blind spots. However, current state-of-the-art vision-based roadside…

3D Object DetectionAutonomous Vehiclesobject-detectionObject Detection

Generating Human-Centric Visual Cues for Human-Object Interaction Detection via Large Vision-Language Models

2023-11-26 · Yu-Wei Zhan, Fan Liu, Xin Luo, Liqiang Nie 외

Human-object interaction (HOI) detection aims at detecting human-object pairs and predicting their interactions. However, the complexity of human behavior and the diverse contexts in which these interactions occur make i…

Human-Object Interaction Detection

PAL: Intelligence Augmentation using Egocentric Visual Context Detection

2021-05-22 · Mina Khan, Pattie Maes

Egocentric visual context detection can support intelligence augmentation applications. We created a wearable system, called PAL, for wearable, personalized, and privacy-preserving egocentric visual context detection. PA…

ClusteringDeep LearningFace DetectionPrivacy Preserving

EgoObjects: A Large-Scale Egocentric Dataset for Fine-Grained Object Understanding

2023-09-15 · ICCV 2023 1 · Chenchen Zhu, Fanyi Xiao, Andres Alvarado, Yasmine Babaei 외

Object understanding in egocentric visual data is arguably a fundamental research topic in egocentric vision. However, existing object datasets are either non-egocentric or have limitations in object categories, visual c…

Continual LearningObjectobject-detectionObject Detection