Speeding up Resnet Architecture with Layers Targeted Low Rank Decomposition

2023-09-21 · Walid Ahmed, Habib Hajimolahoseini, Austin Wen, Yang Liu

Compression of a neural network can help in speeding up both the training and the inference of the network. In this research, we study applying compression using low rank decomposition on network layers. Our research demonstrates that to acquire a speed up, the compression methodology should be aware of the underlying hardware as analysis should be done to choose which layers to compress. The advantage of our approach is demonstrated via a case study of compressing ResNet50 and training on full ImageNet-ILSVRC2012. We tested on two different hardware systems Nvidia V100 and Huawei Ascend910. With hardware targeted compression, results on Ascend910 showed 5.36% training speedup and 15.79% inference speed on Ascend310 with only 1% drop in accuracy compared to the original uncompressed model

📄 PDF Abstract BibTeX arXiv:2309.12412

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Speeding up Convolutional Neural Networks with Low Rank Expansions

2014-05-15 · Max Jaderberg, Andrea Vedaldi, Andrew Zisserman

The focus of this paper is speeding up the evaluation of convolutional neural networks. While delivering impressive results across a range of computer vision and machine learning tasks, these networks are computationally…

CPU GPU Model Compression

Directed-Weighting Group Lasso for Eltwise Blocked CNN Pruning

2019-10-21 · Ke Zhan, Shimiao Jiang, Yu Bai, Yi Li 외

Eltwise layer is a commonly used structure in the multi-branch deep learning network. In a filter-wise pruning procedure, due to the specific operation of the eltwise layer, all its previous convolutional layers should v…

Speeding-up Convolutional Neural Networks Using Fine-tuned CP-Decomposition

2014-12-19 · Vadim Lebedev, Yaroslav Ganin, Maksim Rakhuba, Ivan Oseledets 외

We propose a simple two-step approach for speeding up convolution layers within large convolutional neural networks based on tensor decomposition and discriminative fine-tuning. Given a layer, we use non-linear least squ…

CPU General Classification Tensor Decomposition

Adaptive Rank Allocation: Speeding Up Modern Transformers with RaNA Adapters

2025-03-23 · Roberto Garcia, Jerry Liu, Daniel Sorvisto, Sabri Eyuboglu

Large Language Models (LLMs) are computationally intensive, particularly during inference. Neuron-adaptive techniques, which selectively activate neurons in Multi-Layer Perceptron (MLP) layers, offer some speedups but su…

Speeding Up EfficientNet: Selecting Update Blocks of Convolutional Neural Networks using Genetic Algorithm in Transfer Learning

2023-03-01 · Md. Mehedi Hasana, Muhammad Ibrahim, Md. Sawkat Ali

The performance of convolutional neural networks (CNN) depends heavily on their architectures. Transfer learning performance of a CNN relies quite strongly on selection of its trainable layers. Selecting the most effecti…

Transfer Learning