paper-with-me

Papers

Selectively Dilated Convolution for Accuracy-Preserving Sparse Pillar-based Embedded 3D Object Detection

2024-08-25 · Seongmin Park, Minjae Lee, Junwon Choi, Jungwook Choi

Pillar-based 3D object detection has gained traction in self-driving technology due to its speed and accuracy facilitated by the artificial densification of pillars for GPU-friendly processing. However, dense pillar processing fundamentally wastes computation since it ignores the inherent sparsity of pillars derived from scattered point cloud data. Motivated by recent embedded accelerators with native sparsity support, sparse pillar convolution methods like submanifold convolution (SubM-Conv) aimed to reduce these redundant computations by applying convolution only on active pillars but suffered considerable accuracy loss. Our research identifies that this accuracy loss is due to the restricted fine-grained spatial information flow (fSIF) of SubM-Conv in sparse pillar networks. To overcome this restriction, we propose a selectively dilated (SD-Conv) convolution that evaluates the importance of encoded pillars and selectively dilates the convolution output, enhancing the receptive field for critical pillars and improving object detection accuracy. To facilitate actual acceleration with this novel convolution approach, we designed SPADE+ as a cost-efficient augmentation to existing embedded sparse convolution accelerators. This design supports the SD-Conv without significant demands in area and SRAM size, realizing superior trade-off between the speedup and model accuracy. This strategic enhancement allows our method to achieve extreme pillar sparsity, leading to up to 18.1x computational savings and 16.2x speedup on the embedded accelerators, without compromising object detection accuracy.

📄 PDF Abstract BibTeX arXiv:2408.13798

Code (0)

등록된 구현이 없습니다.

Tasks

3D Object DetectionGPUobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
Submanifold Convolution Submanifold Convolution (SC) is a spatially sparse convolution operation used for tasks with sparse data like semantic…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

RAT+: Train Dense, Infer Sparse -- Recurrence Augmented Attention for Dilated Inference

2026-02-20 · Xiuying Wei, Caglar Gulcehre arxiv

Structured dilated attention has an appealing inference-time efficiency knob: it reduces the FLOPs of attention and the KV cache size by a factor of the dilation size D, while preserving long-range connectivity. While pr…

Dilated convolution neural operator for multiscale partial differential equations

2024-07-16 · Bo Xu, Xinliang Liu, Lei Zhang

This paper introduces a data-driven operator learning method for multiscale partial differential equations, with a particular emphasis on preserving high-frequency information. Drawing inspiration from the representation…

Operator learning

CASSOD-Net: Cascaded and Separable Structures of Dilated Convolution for Embedded Vision Systems and Applications

2021-04-29 · Tse-Wei Chen, Deyu Wang, Wei Tao, Dongchao Wen 외

The field of view (FOV) of convolutional neural networks is highly related to the accuracy of inference. Dilated convolutions are known as an effective solution to the problems which require large FOVs. However, for gene…

Face DetectionImage SegmentationSemantic Segmentation

Towards Understanding Residual and Dilated Dense Neural Networks via Convolutional Sparse Coding

2019-12-05 · Zhiyang Zhang, Shihua Zhang

Convolutional neural network (CNN) and its variants have led to many state-of-art results in various fields. However, a clear theoretical understanding about them is still lacking. Recently, multi-layer convolutional spa…

Adaptive Fractional Dilated Convolution Network for Image Aesthetics Assessment

2020-04-06 · CVPR 2020 6 · Qiuyu Chen, Wei zhang, Ning Zhou, Peng Lei 외

To leverage deep learning for image aesthetics assessment, one critical but unsolved issue is how to seamlessly incorporate the information of image aspect ratios to learn more robust models. In this paper, an adaptive f…