paper-with-me

Papers

3D Point Cloud Network Pruning: When Some Weights Do not Matter

2024-08-26 · Amrijit Biswas, Md. Ismail Hossain, M M Lutfe Elahi, Ali Cheraghian, Fuad Rahman, Nabeel Mohammed, Shafin Rahman

A point cloud is a crucial geometric data structure utilized in numerous applications. The adoption of deep neural networks referred to as Point Cloud Neural Networks (PC- NNs), for processing 3D point clouds, has significantly advanced fields that rely on 3D geometric data to enhance the efficiency of tasks. Expanding the size of both neural network models and 3D point clouds introduces significant challenges in minimizing computational and memory requirements. This is essential for meeting the demanding requirements of real-world applications, which prioritize minimal energy consumption and low latency. Therefore, investigating redundancy in PCNNs is crucial yet challenging due to their sensitivity to parameters. Additionally, traditional pruning methods face difficulties as these networks rely heavily on weights and points. Nonetheless, our research reveals a promising phenomenon that could refine standard PCNN pruning techniques. Our findings suggest that preserving only the top p% of the highest magnitude weights is crucial for accuracy preservation. For example, pruning 99% of the weights from the PointNet model still results in accuracy close to the base level. Specifically, in the ModelNet40 dataset, where the base accuracy with the PointNet model was 87. 5%, preserving only 1% of the weights still achieves an accuracy of 86.8%. Codes are available in: https://github.com/apurba-nsu-rnd-lab/PCNN_Pruning

📄 PDF Abstract BibTeX arXiv:2408.14601

Code (1)

apurba-nsu-rnd-lab/pcnn_pruning 공식 구현 pytorch

Tasks

Network Pruning

Methods 이 논문이 사용한 방법론

Pruning 설명 없음
BASE 설명 없음

Similar Papers 제목 키워드 기반

Enhancing the Regularization Effect of Weight Pruning in Artificial Neural Networks

2018-05-04 · Brian Bartoldson, Adrian Barbu, Gordon Erlebacher

Artificial neural networks (ANNs) may not be worth their computational/memory costs when used in mobile phones or embedded devices. Parameter-pruning algorithms combat these costs, with some algorithms capable of removin…

General Classificationimage-classificationImage Classification

CP$^3$: Channel Pruning Plug-in for Point-based Networks

2023-03-23 · Yaomin Huang, Ning Liu, Zhengping Che, Zhiyuan Xu 외

Channel pruning can effectively reduce both computational cost and memory footprint of the original network while keeping a comparable accuracy performance. Though great success has been achieved in channel pruning for 2…

CP3: Channel Pruning Plug-In for Point-Based Networks

2023-01-01 · CVPR 2023 1 · Yaomin Huang, Ning Liu, Zhengping Che, Zhiyuan Xu 외

Channel pruning has been widely studied as a prevailing method that effectively reduces both computational cost and memory footprint of the original network while keeping a comparable accuracy performance. Though gre…

As easy as PIE: understanding when pruning causes language models to disagree

2025-03-27 · Pietro Tropeano, Maria Maistro, Tuukka Ruotsalo, Christina Lioma

Language Model (LM) pruning compresses the model by removing weights, nodes, or other parts of its architecture. Typically, pruning focuses on the resulting efficiency gains at the cost of effectiveness. However, when lo…

Efficient 3D Perception on Multi-Sweep Point Cloud with Gumbel Spatial Pruning

2024-11-12 · Tianyu Sun, Jianhao Li, Xueqian Zhang, Zhongdao Wang 외

This paper studies point cloud perception within outdoor environments. Existing methods face limitations in recognizing objects located at a distance or occluded, due to the sparse nature of outdoor point clouds. In this…

3D Object Detectionobject-detectionObject Detection