paper-with-me

Papers

Effective, Fast, and Memory-Efficient Compressed Multi-function Convolutional Neural Networks with Compact Inception-V4

2018-10-20 · Luna Zhang

Google's Inception-V4 using an activation function RELU is a very deep convolutional neural network (CNN) that consists of 4 Inception-A blocks, 7 Inception-B blocks, and 3 Inception-C blocks. To improve classification performance, reduce training and testing times, and reduce power consumption and memory usage (model size), a new "Compressed Multi-function Inception-V4" (CMIV4) using different activation functions is created by using k Inception-A blocks, m Inception-B blocks, and n Inception-C blocks where k = {1, 2, 3, or 4}, m = {1, 2, 3, 4, 5, 6, or 7}, n = {1, 2, or 3}, and (k+m+n)<14. For performance analysis, two datasets for two different applications (classifying brain MRI images into one of the four stages of Alzheimer's disease and using a sample of CIFAR-10 data) are used to compare three CMIV4 architectures with Inception-V4 in terms of F1-score, training and testing times (related to power consumption), and memory usage (model size). Overall, simulations show that the new CMIV4 can outperform both the commonly used single-function CNN with Inception-V4 and multi-function CNNs with Inception-V4. In the future, other compressed multi-function CNNs, such as compressed multi-function ResNets and compressed multi-function DenseNets with a reduced number of convolutional blocks using different activation functions, will be developed to increase classification accuracy, reduce training and testing times, reduce computational power, and reduce memory usage (model size) for industrial applications in IoT, big data mining, green computing, etc.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Effective, Fast, and Memory-Efficient Compressed Multi-function Convolutional Neural Networks for More Accurate Medical Image Classification

2018-11-29 · Luna M. Zhang

Convolutional Neural Networks (CNNs) usually use the same activation function, such as RELU, for all convolutional layers. There are performance limitations of just using RELU. In order to achieve better classification p…

General Classificationimage-classificationImage ClassificationMedical Image Classification

A New Compensatory Genetic Algorithm-Based Method for Effective Compressed Multi-function Convolutional Neural Network Model Selection with Multi-Objective Optimization

2019-06-08 · Luna M. Zhang

In recent years, there have been many popular Convolutional Neural Networks (CNNs), such as Google's Inception-V4, that have performed very well for various image classification problems. These commonly used CNN models u…

ClassificationGeneral Classificationimage-classificationImage Classification+1

CARAMEL: A Succinct Read-Only Lookup Table via Compressed Static Functions

2023-05-26 · Benjamin Coleman, David Torres Ramos, Vihan Lakshman, Chen Luo 외

Lookup tables are a fundamental structure in many data processing and systems applications. Examples include tokenized text in NLP, quantized embedding collections in recommendation systems, integer sketches for streamin…

Recommendation Systems

Fast Randomized Subspace System Identification for Large I/O Data

2023-03-02 · Vatsal Kedia, Debraj Chakraborty

In this article, a novel fast randomized subspace system identification method for estimating combined deterministic-stochastic LTI state-space models, is proposed. The algorithm is especially well-suited to identify hig…

State Space Modelssubspace methods

On the Acceleration of Deep Neural Network Inference using Quantized Compressed Sensing

2021-08-23 · Meshia Cédric Oveneke

Accelerating deep neural network (DNN) inference on resource-limited devices is one of the most important barriers to ensuring a wider and more inclusive adoption. To alleviate this, DNN binary quantization for faster co…

compressed sensingQuantization