paper-with-me

홈 › Papers

GeoBEV: Learning Geometric BEV Representation for Multi-view 3D Object Detection

2024-09-03 · Jinqing Zhang, Yanan Zhang, Yunlong Qi, Zehua Fu, Qingjie Liu, Yunhong Wang

Bird's-Eye-View (BEV) representation has emerged as a mainstream paradigm for multi-view 3D object detection, demonstrating impressive perceptual capabilities. However, existing methods overlook the geometric quality of BEV representation, leaving it in a low-resolution state and failing to restore the authentic geometric information of the scene. In this paper, we identify the drawbacks of previous approaches that limit the geometric quality of BEV representation and propose Radial-Cartesian BEV Sampling (RC-Sampling), which outperforms other feature transformation methods in efficiently generating high-resolution dense BEV representation to restore fine-grained geometric information. Additionally, we design a novel In-Box Label to substitute the traditional depth label generated from the LiDAR points. This label reflects the actual geometric structure of objects rather than just their surfaces, injecting real-world geometric information into the BEV representation. In conjunction with the In-Box Label, Centroid-Aware Inner Loss (CAI Loss) is developed to capture the inner geometric structure of objects. Finally, we integrate the aforementioned modules into a novel multi-view 3D object detector, dubbed GeoBEV, which achieves a state-of-the-art result of 66.2\% NDS on the nuScenes test set. The code is available at https://github.com/mengtan00/GeoBEV.git.

📄 PDF Abstract BibTeX arXiv:2409.01816

Code (1)

mengtan00/geobev 공식 구현 pytorch

Tasks

3D Object Detectionobject-detectionObject Detection

Similar Papers 제목 키워드 기반

unPIC: A Geometric Multiview Prior for Image to 3D Synthesis

2024-12-13 · Rishabh Kabra, Drew A. Hudson, Sjoerd van Steenkiste, Joao Carreira 외

We introduce a hierarchical probabilistic approach to go from a 2D image to multiview 3D: a diffusion "prior" predicts the unseen 3D geometry, which then conditions a diffusion "decoder" to generate novel views of the su…

3D geometryDecoderImage to 3DNovel View Synthesis

Geometry-biased Transformers for Novel View Synthesis

2023-01-11 · Naveen Venkat, Mayank Agarwal, Maneesh Singh, Shubham Tulsiani

We tackle the task of synthesizing novel views of an object given a few input images and associated camera viewpoints. Our work is inspired by recent 'geometry-free' approaches where multi-view images are encoded as a (g…

Novel View Synthesis

Visual Graphs from Motion (VGfM): Scene understanding with object geometry reasoning

2018-07-16 · Paul Gay, Stuart James, Alessio Del Bue

Recent approaches on visual scene understanding attempt to build a scene graph -- a computational representation of objects and their pairwise relationships. Such rich semantic representation is very appealing, yet diffi…

3d scene graph generationGraph GenerationScene Graph GenerationScene Understanding

Sharp-It: A Multi-view to Multi-view Diffusion Model for 3D Synthesis and Manipulation

2024-12-03 · CVPR 2025 1 · Yiftach Edelstein, Or Patashnik, Dana Cohen-Bar, Lihi Zelnik-Manor

Advancements in text-to-image diffusion models have led to significant progress in fast 3D content creation. One common approach is to generate a set of multi-view images of an object, and then reconstruct it into a 3D m…

VGGT-Det: Mining VGGT Internal Priors for Sensor-Geometry-Free Multi-View Indoor 3D Object Detection

2026-03-01 · Yang Cao, Feize Wu, Dave Zhenyu Chen, Yingji Zhong 외 arxiv

Current multi-view indoor 3D object detectors rely on sensor geometry that is costly to obtain (i.e., precisely calibrated multi-view camera poses) to fuse multi-view information into a global scene representation, limit…

3D Object Detection