paper-with-me

Papers

PolarBEVDet: Exploring Polar Representation for Multi-View 3D Object Detection in Bird's-Eye-View

2024-08-29 · Zichen Yu, Quanli Liu, Wei Wang, Liyong Zhang, Xiaoguang Zhao

Recently, LSS-based multi-view 3D object detection provides an economical and deployment-friendly solution for autonomous driving. However, all the existing LSS-based methods transform multi-view image features into a Cartesian Bird's-Eye-View(BEV) representation, which does not take into account the non-uniform image information distribution and hardly exploits the view symmetry. In this paper, in order to adapt the image information distribution and preserve the view symmetry by regular convolution, we propose to employ the polar BEV representation to substitute the Cartesian BEV representation. To achieve this, we elaborately tailor three modules: a polar view transformer to generate the polar BEV representation, a polar temporal fusion module for fusing historical polar BEV features and a polar detection head to predict the polar-parameterized representation of the object. In addition, we design a 2D auxiliary detection head and a spatial attention enhancement module to improve the quality of feature extraction in perspective view and BEV, respectively. Finally, we integrate the above improvements into a novel multi-view 3D object detector, PolarBEVDet. Experiments on nuScenes show that PolarBEVDet achieves the superior performance. The code is available at https://github.com/Yzichen/PolarBEVDet.git.(This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible)

📄 PDF Abstract BibTeX arXiv:2408.16200

Code (1)

yzichen/polarbevdet 공식 구현 pytorch

Tasks

3D Object DetectionAutonomous DrivingObjectobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

MONET: Multiview Semi-supervised Keypoint Detection via Epipolar Divergence

2018-05-31 · ICCV 2019 10 · Yuan Yao, Yasamin Jafarian, Hyun Soo Park

This paper presents MONET -- an end-to-end semi-supervised learning framework for a keypoint detector using multiview image streams. In particular, we consider general subjects such as non-human species where attaining a…

Data AugmentationKeypoint Detection

3D Scene Reconstruction with Multi-layer Depth and Epipolar Transformers

2019-02-18 · ICCV 2019 10 · Daeyun Shin, Zhile Ren, Erik B. Sudderth, Charless C. Fowlkes

We tackle the problem of automatically reconstructing a complete 3D model of a scene from a single RGB image. This challenging task requires inferring the shape of both visible and occluded surfaces. Our approach utilize…

3D Scene Reconstruction

NeRSP: Neural 3D Reconstruction for Reflective Objects with Sparse Polarized Images

2024-06-11 · CVPR 2024 1 · Yufei Han, Heng Guo, Koki Fukai, Hiroaki Santo 외

We present NeRSP, a Neural 3D reconstruction technique for Reflective surfaces with Sparse Polarized images. Reflective surface reconstruction is extremely challenging as specular reflections are view-dependent and thus …

3D ReconstructionSurface Reconstruction

P $\approx$ NP, at least in Visual Question Answering

2020-03-26 · Shailza Jolly, Sebastian Palacio, Joachim Folz, Federico Raue 외

In recent years, progress in the Visual Question Answering (VQA) field has largely been driven by public challenges and large datasets. One of the most widely-used of these is the VQA 2.0 dataset, consisting of polar ("y…

Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)

Multi-View Industrial Anomaly Detection with Epipolar Constrained Cross-View Fusion

2025-03-14 · Yifan Liu, Xun Xu, Shijie Li, Jingyi Liao 외

Multi-camera systems provide richer contextual information for industrial anomaly detection. However, traditional methods process each view independently, disregarding the complementary information across viewpoints. Exi…

Anomaly Detection