PerforatedCNNs: Acceleration through Elimination of Redundant Convolutions
We propose a novel approach to reduce the computational cost of evaluation of convolutional neural networks, a factor that has hindered their deployment in low-power devices such as mobile phones. Inspired by the loop perforation technique from source code optimization, we speed up the bottleneck convolutional layers by skipping their evaluation in some of the spatial positions. We propose and analyze several strategies of choosing these positions. We demonstrate that perforation can accelerate modern convolutional networks such as AlexNet and VGG-16 by a factor of 2x - 4x. Additionally, we show that perforation is complementary to the recently proposed acceleration method of Zhang et al.
Code (2)
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
PhotoGAN: Generative Adversarial Neural Network Acceleration with Silicon Photonics
Generative Adversarial Networks (GANs) are at the forefront of AI innovation, driving advancements in areas such as image synthesis, medical imaging, and data augmentation. However, the unique computational operations wi…
Computational EfficiencyData AugmentationImage GenerationEfficient Accelerator for Dilated and Transposed Convolution with Decomposition
Hardware acceleration for dilated and transposed convolution enables real time execution of related tasks like segmentation, but current designs are specific for these convolutional types or suffer from complex control f…
Designing by Training: Acceleration Neural Network for Fast High-Dimensional Convolution
The high-dimensional convolution is widely used in various disciplines but has a serious performance problem due to its high computational complexity. Over the decades, people took a handmade approach to design fast algo…
Vocal Bursts Intensity PredictionElimination of Redundant Polynomial Constraints and Its Use in Constrained Control
The reduction of constraints to obtain minimal representations of sets is a very common problem in many engineering applications. While well-established methodologies exist for the case of linear constraints, the problem…
Model Predictive ControlHow to Accelerate Capsule Convolutions in Capsule Networks
How to improve the efficiency of routing procedures in CapsNets has been studied a lot. However, the efficiency of capsule convolutions has largely been neglected. Capsule convolution, which uses capsules rather than neu…