paper-with-me

Papers

FlashOcc: Fast and Memory-Efficient Occupancy Prediction via Channel-to-Height Plugin

2023-11-18 · Zichen Yu, Changyong Shu, Jiajun Deng, Kangjie Lu, Zongdai Liu, Jiangyong Yu, Dawei Yang, Hui Li, Yan Chen

Given the capability of mitigating the long-tail deficiencies and intricate-shaped absence prevalent in 3D object detection, occupancy prediction has become a pivotal component in autonomous driving systems. However, the procession of three-dimensional voxel-level representations inevitably introduces large overhead in both memory and computation, obstructing the deployment of to-date occupancy prediction approaches. In contrast to the trend of making the model larger and more complicated, we argue that a desirable framework should be deployment-friendly to diverse chips while maintaining high precision. To this end, we propose a plug-and-play paradigm, namely FlashOCC, to consolidate rapid and memory-efficient occupancy prediction while maintaining high precision. Particularly, our FlashOCC makes two improvements based on the contemporary voxel-level occupancy prediction approaches. Firstly, the features are kept in the BEV, enabling the employment of efficient 2D convolutional layers for feature extraction. Secondly, a channel-to-height transformation is introduced to lift the output logits from the BEV into the 3D space. We apply the FlashOCC to diverse occupancy prediction baselines on the challenging Occ3D-nuScenes benchmarks and conduct extensive experiments to validate the effectiveness. The results substantiate the superiority of our plug-and-play paradigm over previous state-of-the-art methods in terms of precision, runtime efficiency, and memory costs, demonstrating its potential for deployment. The code will be made available.

📄 PDF Abstract BibTeX arXiv:2311.12058

Code (1)

Yzichen/FlashOCC 공식 구현 pytorch

Tasks

3D Object DetectionAutonomous Drivingobject-detectionObject DetectionPrediction

Similar Papers 제목 키워드 기반

Panoptic-FlashOcc: An Efficient Baseline to Marry Semantic Occupancy with Panoptic via Instance Center

2024-06-15 · Zichen Yu, Changyong Shu, Qianpu Sun, Yifan Bian 외

Panoptic occupancy poses a novel challenge by aiming to integrate instance occupancy and semantic occupancy within a unified framework. However, there is still a lack of efficient solutions for panoptic occupancy. In thi…

UltimateDO: An Efficient Framework to Marry Occupancy Prediction with 3D Object Detection via Channel2height

2024-09-17 · Zichen Yu, Changyong Shu

Occupancy and 3D object detection are characterized as two standard tasks in modern autonomous driving system. In order to deploy them on a series of edge chips with better precision and time-consuming trade-off, contemp…

3D Object DetectionAutonomous DrivingObjectobject-detection+2

MambaOcc: Visual State Space Model for BEV-based Occupancy Prediction with Local Adaptive Reordering

2024-08-21 · Yonglin Tian, Songlin Bai, Zhiyao Luo, Yutong Wang 외

Occupancy prediction has attracted intensive attention and shown great superiority in the development of autonomous driving systems. The fine-grained environmental representation brought by occupancy prediction in terms …

Autonomous DrivingComputational EfficiencyMambaPrediction

Lightweight Spatial Embedding for Vision-based 3D Occupancy Prediction

2024-12-08 · Jinqing Zhang, Yanan Zhang, Qingjie Liu, Yunhong Wang

Occupancy prediction has garnered increasing attention in recent years for its comprehensive fine-grained environmental representation and strong generalization to open-set objects. However, cumbersome voxel features and…

Autonomous DrivingPrediction

GEM-Occ: From Visual Geometry Evidence to Embodied Semantic Occupancy Memory

2026-07-06 · Hu Zhu, Bohan Li, Xianda Guo, Hongsi Liu 외 arxiv

Semantic occupancy provides a structured spatial memory for embodied indoor agents by jointly representing occupied regions, observed free space, unknown areas, and object semantics. However, existing indoor occupancy be…