paper-with-me

홈 › Papers

HeightFormer: Explicit Height Modeling without Extra Data for Camera-only 3D Object Detection in Bird's Eye View

2023-07-25 · Yiming Wu, Ruixiang Li, Zequn Qin, Xinhai Zhao, Xi Li

Vision-based Bird's Eye View (BEV) representation is an emerging perception formulation for autonomous driving. The core challenge is to construct BEV space with multi-camera features, which is a one-to-many ill-posed problem. Diving into all previous BEV representation generation methods, we found that most of them fall into two types: modeling depths in image views or modeling heights in the BEV space, mostly in an implicit way. In this work, we propose to explicitly model heights in the BEV space, which needs no extra data like LiDAR and can fit arbitrary camera rigs and types compared to modeling depths. Theoretically, we give proof of the equivalence between height-based methods and depth-based methods. Considering the equivalence and some advantages of modeling heights, we propose HeightFormer, which models heights and uncertainties in a self-recursive way. Without any extra data, the proposed HeightFormer could estimate heights in BEV accurately. Benchmark results show that the performance of HeightFormer achieves SOTA compared with those camera-only methods.

📄 PDF Abstract BibTeX arXiv:2307.13510

Code (0)

등록된 구현이 없습니다.

Tasks

3D Object DetectionAutonomous Drivingobject-detectionObject Detection

Similar Papers 제목 키워드 기반

HeightFormer: Learning Height Prediction in Voxel Features for Roadside Vision Centric 3D Object Detection via Transformer

2025-03-13 · Zhang Zhang, Chao Sun, Chao Yue, Da Wen 외

Roadside vision centric 3D object detection has received increasing attention in recent years. It expands the perception range of autonomous vehicles, enhances the road safety. Previous methods focused on predicting per-…

3D Object DetectionAutonomous Vehiclesobject-detectionObject Detection

HeightFormer: A Semantic Alignment Monocular 3D Object Detection Method from Roadside Perspective

2024-10-10 · Pei Liu, Zihao Zhang, Haipeng Liu, Nanfang Zheng 외

The on-board 3D object detection technology has received extensive attention as a critical technology for autonomous driving, while few studies have focused on applying roadside sensors in 3D traffic object detection. Ex…

3D Object DetectionAutonomous DrivingMonocular 3D Object DetectionObject+3

HeightFormer: A Multilevel Interaction and Image-adaptive Classification-regression Network for Monocular Height Estimation with Aerial Images

2023-10-12 · Zhan Chen, Yidan Zhang, Xiyu Qi, Yongqiang Mao 외

Height estimation has long been a pivotal topic within measurement and remote sensing disciplines, proving critical for endeavours such as 3D urban modelling, MR and autonomous driving. Traditional methods utilise stereo…

Autonomous DrivingregressionStereo Matching

HeightMapNet: Explicit Height Modeling for End-to-End HD Map Learning

2024-11-03 · Wenzhao Qiu, Shanmin Pang, Hao Zhang, Jianwu Fang 외

Recent advances in high-definition (HD) map construction from surround-view images have highlighted their cost-effectiveness in deployment. However, prevailing techniques often fall short in accurately extracting and uti…

HeightLane: BEV Heightmap guided 3D Lane Detection

2024-08-15 · Chaesong Park, Eunbin Seo, Jongwoo Lim

Accurate 3D lane detection from monocular images presents significant challenges due to depth ambiguity and imperfect ground modeling. Previous attempts to model the ground have often used a planar ground assumption with…

3D Lane DetectionLane Detection