paper-with-me

홈 › Papers

DualBEV: Unifying Dual View Transformation with Probabilistic Correspondences

2024-03-08 · Peidong Li, Wancheng Shen, Qihao Huang, Dixiao Cui

Camera-based Bird's-Eye-View (BEV) perception often struggles between adopting 3D-to-2D or 2D-to-3D view transformation (VT). The 3D-to-2D VT typically employs resource-intensive Transformer to establish robust correspondences between 3D and 2D features, while the 2D-to-3D VT utilizes the Lift-Splat-Shoot (LSS) pipeline for real-time application, potentially missing distant information. To address these limitations, we propose DualBEV, a unified framework that utilizes a shared feature transformation incorporating three probabilistic measurements for both strategies. By considering dual-view correspondences in one stage, DualBEV effectively bridges the gap between these strategies, harnessing their individual strengths. Our method achieves state-of-the-art performance without Transformer, delivering comparable efficiency to the LSS approach, with 55.2% mAP and 63.4% NDS on the nuScenes test set. Code is available at \url{https://github.com/PeidongLi/DualBEV}

📄 PDF Abstract BibTeX arXiv:2403.05402

Code (1)

peidongli/dualbev 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Multi-Head Attention 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

General Supervision via Probabilistic Transformations

2019-01-24 · Santiago Mazuelas, Aritz Perez

Different types of training data have led to numerous schemes for supervised classification. Current learning techniques are tailored to one specific scheme and cannot handle general ensembles of training data. This pape…

ClassificationGeneral Classification

Unifying Generative Models with GFlowNets and Beyond

2022-09-06 · Dinghuai Zhang, Ricky T. Q. Chen, Nikolay Malkin, Yoshua Bengio

There are many frameworks for deep generative modeling, each often presented with their own specific training algorithms and inference methods. Here, we demonstrate the connections between existing deep generative models…

Decision Making

T1: Scaling Diffusion Probabilistic Fields to High-Resolution on Unified Visual Modalities

2023-05-24 · Kangfu Mei, Mo Zhou, Vishal M. Patel

Diffusion Probabilistic Field (DPF) models the distribution of continuous functions defined over metric spaces. While DPF shows great potential for unifying data generation of various modalities including images, videos,…

3D geometry

A probabilistic framework for multi-view feature learning with many-to-many associations via neural networks

2018-02-13 · ICML 2018 7 · Akifumi Okuno, Tetsuya Hada, Hidetoshi Shimodaira

A simple framework Probabilistic Multi-view Graph Embedding (PMvGE) is proposed for multi-view feature learning with many-to-many associations so that it generalizes various existing multi-view methods. PMvGE is a probab…

Graph Embedding

Resfusion: Denoising Diffusion Probabilistic Models for Image Restoration Based on Prior Residual Noise

2023-11-25 · Zhenning Shi, Haoshuai Zheng, Chen Xu, Changsheng Dong 외

Recently, research on denoising diffusion models has expanded its application to the field of image restoration. Traditional diffusion-based image restoration methods utilize degraded images as conditional input to effec…

DenoisingImage GenerationImage RestorationLow-Light Image Enhancement+2