paper-with-me

Papers

OneBEV: Using One Panoramic Image for Bird's-Eye-View Semantic Mapping

2024-09-20 · Jiale Wei, Junwei Zheng, Ruiping Liu, Jie Hu, Jiaming Zhang, Rainer Stiefelhagen

In the field of autonomous driving, Bird's-Eye-View (BEV) perception has attracted increasing attention in the community since it provides more comprehensive information compared with pinhole front-view images and panoramas. Traditional BEV methods, which rely on multiple narrow-field cameras and complex pose estimations, often face calibration and synchronization issues. To break the wall of the aforementioned challenges, in this work, we introduce OneBEV, a novel BEV semantic mapping approach using merely a single panoramic image as input, simplifying the mapping process and reducing computational complexities. A distortion-aware module termed Mamba View Transformation (MVT) is specifically designed to handle the spatial distortions in panoramas, transforming front-view features into BEV features without leveraging traditional attention mechanisms. Apart from the efficient framework, we contribute two datasets, i.e., nuScenes-360 and DeepAccident-360, tailored for the OneBEV task. Experimental results showcase that OneBEV achieves state-of-the-art performance with 51.1% and 36.1% mIoU on nuScenes-360 and DeepAccident-360, respectively. This work advances BEV semantic mapping in autonomous driving, paving the way for more advanced and reliable autonomous systems.

📄 PDF Abstract BibTeX arXiv:2409.13912

Code (1)

jialewei/onebev 공식 구현 pytorch

Tasks

Autonomous DrivingMamba

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Mamba Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the Transformer architecture and its core attention module.…

Similar Papers 제목 키워드 기반

360BEV: Panoramic Semantic Mapping for Indoor Bird's-Eye View

2023-03-21 · Zhifeng Teng, Jiaming Zhang, Kailun Yang, Kunyu Peng 외

Seeing only a tiny part of the whole is not knowing the full circumstance. Bird's-eye-view (BEV) perception, a process of obtaining allocentric maps from egocentric views, is restricted when using a narrow Field of View …

Semantic Segmentation

KD360-VoxelBEV: LiDAR and 360-degree Camera Cross Modality Knowledge Distillation for Bird's-Eye-View Segmentation

2025-12-17 · Wenke E, Yixin Sun, Jiaxu Liu, Hubert P. H. Shum 외 arxiv

We present the first cross-modality distillation framework specifically tailored for single-panoramic-camera Bird's-Eye-View (BEV) segmentation. Our approach leverages a novel LiDAR image representation fused from range,…

Knowledge DistillationAutonomous DrivingBEV Segmentation

BevSplat: Resolving Height Ambiguity via Feature-Based Gaussian Primitives for Weakly-Supervised Cross-View Localization

2025-02-13 · Qiwei Wang, Shaoxun Wu, Yujiao Shi

This paper addresses the problem of weakly supervised cross-view localization, where the goal is to estimate the pose of a ground camera relative to a satellite image with noisy ground truth annotations. A common approac…

Pose Estimation

Multi-source Domain Adaptation for Panoramic Semantic Segmentation

2024-08-29 · Jing Jiang, Sicheng Zhao, Jiankun Zhu, Wenbo Tang 외

Unsupervised domain adaptation methods for panoramic semantic segmentation utilize real pinhole images or low-cost synthetic panoramic images to transfer segmentation models to real panoramic images. However, these metho…

Domain AdaptationSegmentationSemantic SegmentationUnsupervised Domain Adaptation

Hallucinating 360°: Panoramic Street-View Generation via Local Scenes Diffusion and Probabilistic Prompting

2025-07-09 · Fei Teng, Kai Luo, Sheng Wu, Siyu Li 외 arxiv

Panoramic perception holds significant potential for autonomous driving, enabling vehicles to acquire a comprehensive 360° surround view in a single shot. However, autonomous driving is a data-driven task. Complete panor…

Image Quality AssessmentAutonomous DrivingImage Generation