paper-with-me

Papers

BDC-Occ: Binarized Deep Convolution Unit For Binarized Occupancy Network

2024-05-27 · Zongkai Zhang, Zidong Xu, Wenming Yang, Qingmin Liao, Jing-Hao Xue

Existing 3D occupancy networks demand significant hardware resources, hindering the deployment of edge devices. Binarized Neural Networks (BNN) offer substantially reduced computational and memory requirements. However, their performance decreases notably compared to full-precision networks. Moreover, it is challenging to enhance the performance of binarized models by increasing the number of binarized convolutional layers, which limits their practicability for 3D occupancy prediction. To bridge these gaps, we propose a novel binarized deep convolution (BDC) unit that effectively enhances performance while increasing the number of binarized convolutional layers. Firstly, through theoretical analysis, we demonstrate that 1 \times 1 binarized convolutions introduce minimal binarization errors. Therefore, additional binarized convolutional layers are constrained to 1 \times 1 in the BDC unit. Secondly, we introduce the per-channel weight branch to mitigate the impact of binarization errors from unimportant channel features on the performance of binarized models, thereby improving performance while increasing the number of binarized convolutional layers. Furthermore, we decompose the 3D occupancy network into four convolutional modules and utilize the proposed BDC unit to binarize these modules. Our BDC-Occ model is created by applying the proposed BDC unit to binarize the existing 3D occupancy networks. Comprehensive quantitative and qualitative experiments demonstrate that the proposed BDC-Occ is the state-of-the-art binarized 3D occupancy network algorithm.

📄 PDF Abstract BibTeX arXiv:2405.17037

Code (1)

zzk785089755/BDC 공식 구현 pytorch

Tasks

Binarization

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Binarized Spectral Compressive Imaging

2023-05-17 · NeurIPS 2023 11 · Yuanhao Cai, Yuxin Zheng, Jing Lin, Xin Yuan 외

Existing deep learning models for hyperspectral image (HSI) reconstruction achieve good performance but require powerful hardwares with enormous memory and computational resources. Consequently, these methods can hardly …

Binarization

PBGen: Partial Binarization of Deconvolution-Based Generators for Edge Intelligence

2018-02-26 · Jinglan Liu, Jiaxin Zhang, Yukun Ding, Xiaowei Xu 외

This work explores the binarization of the deconvolution-based generator in a GAN for memory saving and speedup of image construction. Our study suggests that different from convolutional neural networks (including the d…

Binarization

10K is Enough: An Ultra-Lightweight Binarized Network for Infrared Small-Target Detection

2025-03-04 · Biqiao Xin, Qianchen Mao, Bingshu Wang, Jiangbin Zheng 외

The widespread deployment of InfRared Small-Target Detection(IRSTD) algorithms on edge devices necessitates the exploration of model compression techniques. Binary neural networks (BNNs) are distinguished by their except…

BinarizationModel Compression

Variation-aware Binarized Memristive Networks

2019-10-14 · Corey Lammie, Olga Krestinskaya, Alex James, Mostafa Rahimi Azghadi

The quantization of weights to binary states in Deep Neural Networks (DNNs) can replace resource-hungry multiply accumulate operations with simple accumulations. Such Binarized Neural Networks (BNNs) exhibit greatly redu…

Quantization

BILLNET: A Binarized Conv3D-LSTM Network with Logic-gated residual architecture for hardware-efficient video inference

2025-01-24 · Van Thien Nguyen, William Guicquero, Gilles Sicard

Long Short-Term Memory (LSTM) and 3D convolution (Conv3D) show impressive results for many video-based applications but require large memory and intensive computing. Motivated by recent works on hardware-algorithmic co-d…