paper-with-me

홈 › Papers

OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perception

2023-03-07 · ICCV 2023 1 · XiaoFeng Wang, Zheng Zhu, Wenbo Xu, Yunpeng Zhang, Yi Wei, Xu Chi, Yun Ye, Dalong Du, Jiwen Lu, Xingang Wang

Semantic occupancy perception is essential for autonomous driving, as automated vehicles require a fine-grained perception of the 3D urban structures. However, existing relevant benchmarks lack diversity in urban scenes, and they only evaluate front-view predictions. Towards a comprehensive benchmarking of surrounding perception algorithms, we propose OpenOccupancy, which is the first surrounding semantic occupancy perception benchmark. In the OpenOccupancy benchmark, we extend the large-scale nuScenes dataset with dense semantic occupancy annotations. Previous annotations rely on LiDAR points superimposition, where some occupancy labels are missed due to sparse LiDAR channels. To mitigate the problem, we introduce the Augmenting And Purifying (AAP) pipeline to ~2x densify the annotations, where ~4000 human hours are involved in the labeling process. Besides, camera-based, LiDAR-based and multi-modal baselines are established for the OpenOccupancy benchmark. Furthermore, considering the complexity of surrounding occupancy perception lies in the computational burden of high-resolution 3D predictions, we propose the Cascade Occupancy Network (CONet) to refine the coarse prediction, which relatively enhances the performance by ~30% than the baseline. We hope the OpenOccupancy benchmark will boost the development of surrounding occupancy perception algorithms.

📄 PDF Abstract BibTeX arXiv:2303.03991

Code (1)

jeffwang987/openoccupancy 공식 구현 pytorch

Tasks

Autonomous DrivingBenchmarkingDiversity

Similar Papers 제목 키워드 기반

Robust 3D Semantic Occupancy Prediction with Calibration-free Spatial Transformation

2024-11-19 · Zhuangwei Zhuang, Ziyin Wang, Sitao Chen, Lizhao Liu 외

3D semantic occupancy prediction, which seeks to provide accurate and comprehensive representations of environment scenes, is important to autonomous driving systems. For autonomous cars equipped with multi-camera and Li…

3D Semantic Occupancy PredictionAutonomous Driving

OccMamba: Semantic Occupancy Prediction with State Space Models

2024-08-19 · CVPR 2025 1 · Heng Li, Yuenan Hou, Xiaohan Xing, Xiao Sun 외

Training deep learning models for semantic occupancy prediction is challenging due to factors such as a large number of occupancy cells, severe occlusion, limited visual cues, complicated driving scenarios, etc. Recent m…

MambaPredictionState Space Models

Hierarchical Temporal Context Learning for Camera-based Semantic Scene Completion

2024-07-02 · Bohan Li, Jiajun Deng, Wenyao Zhang, Zhujin Liang 외

Camera-based 3D semantic scene completion (SSC) is pivotal for predicting complicated 3D layouts with limited 2D image observations. The existing mainstream solutions generally leverage temporal information by roughly st…

3D Semantic Scene Completionvalid

Pano-AVQA: Grounded Audio-Visual Question Answering on 360deg Videos

2021-01-01 · ICCV 2021 10 · Heeseung Yun, Youngjae Yu, Wonsuk Yang, Kangil Lee 외

360deg videos convey holistic views for the surroundings of a scene. It provides audio-visual cues beyond predetermined normal field of views and displays distinctive spatial relations on a sphere. However, previous …

Audio-visual Question AnsweringQuestion AnsweringRelationVisual Question Answering+1

Pano-AVQA: Grounded Audio-Visual Question Answering on 360$^\circ$ Videos

2021-10-11 · Heeseung Yun, Youngjae Yu, Wonsuk Yang, Kangil Lee 외

360$^\circ$ videos convey holistic views for the surroundings of a scene. It provides audio-visual cues beyond pre-determined normal field of views and displays distinctive spatial relations on a sphere. However, previou…

Audio-visual Question AnsweringQuestion AnsweringRelationVisual Question Answering+1