paper-with-me

홈 › Papers

Effective, Fast, and Memory-Efficient Compressed Multi-function Convolutional Neural Networks for More Accurate Medical Image Classification

2018-11-29 · Luna M. Zhang

Convolutional Neural Networks (CNNs) usually use the same activation function, such as RELU, for all convolutional layers. There are performance limitations of just using RELU. In order to achieve better classification performance, reduce training and testing times, and reduce power consumption and memory usage, a new "Compressed Multi-function CNN" is developed. Google's Inception-V4, for example, is a very deep CNN that consists of 4 Inception-A blocks, 7 Inception-B blocks, and 3 Inception-C blocks. RELU is used for all convolutional layers. A new "Compressed Multi-function Inception-V4" (CMI) that can use different activation functions is created with k Inception-A blocks, m Inception-B blocks, and n Inception-C blocks where k in {1, 2, 3, 4}, m in {1, 2, 3, 4, 5, 6, 7}, n in {1, 2, 3}, and (k+m+n)<14. For performance analysis, a dataset for classifying brain MRI images into one of the four stages of Alzheimer's disease is used to compare three CMI architectures with Inception-V4 in terms of F1-score, training and testing times (related to power consumption), and memory usage (model size). Overall, simulations show that the new CMI models can outperform both the commonly used Inception-V4 and Inception-V4 using different activation functions. In the future, other "Compressed Multi-function CNNs", such as "Compressed Multi-function ResNets and DenseNets" that have a reduced number of convolutional blocks using different activation functions, will be developed to further increase classification accuracy, reduce training and testing times, reduce computational power, and reduce memory usage (model size) for building more effective healthcare systems, such as implementing accurate and convenient disease diagnosis systems on mobile devices that have limited battery power and memory.

📄 PDF Abstract BibTeX arXiv:1811.11996

Code (0)

등록된 구현이 없습니다.

Tasks

General Classificationimage-classificationImage ClassificationMedical Image Classification

Methods 이 논문이 사용한 방법론

Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Reduction-A Reduction-A is an image model block used in the Inception-v4 architecture.
Reduction-B Reduction-B is an image model block used in the Inception-v4 architecture.
Inception-v4 Inception-v4 is a convolutional neural network architecture that builds on previous iterations of the Inception family by simplifying the architecture and using more inception…
Inception-C Inception-C is an image model block used in the Inception-v4 architecture.
Inception-B Inception-B is an image model block used in the Inception-v4 architecture.

Similar Papers 제목 키워드 기반

Effective, Fast, and Memory-Efficient Compressed Multi-function Convolutional Neural Networks with Compact Inception-V4

2018-10-20 · Luna Zhang

Google's Inception-V4 using an activation function RELU is a very deep convolutional neural network (CNN) that consists of 4 Inception-A blocks, 7 Inception-B blocks, and 3 Inception-C blocks. To improve classification p…

A New Compensatory Genetic Algorithm-Based Method for Effective Compressed Multi-function Convolutional Neural Network Model Selection with Multi-Objective Optimization

2019-06-08 · Luna M. Zhang

In recent years, there have been many popular Convolutional Neural Networks (CNNs), such as Google's Inception-V4, that have performed very well for various image classification problems. These commonly used CNN models u…

ClassificationGeneral Classificationimage-classificationImage Classification+1

CARAMEL: A Succinct Read-Only Lookup Table via Compressed Static Functions

2023-05-26 · Benjamin Coleman, David Torres Ramos, Vihan Lakshman, Chen Luo 외

Lookup tables are a fundamental structure in many data processing and systems applications. Examples include tokenized text in NLP, quantized embedding collections in recommendation systems, integer sketches for streamin…

Recommendation Systems

Fast Randomized Subspace System Identification for Large I/O Data

2023-03-02 · Vatsal Kedia, Debraj Chakraborty

In this article, a novel fast randomized subspace system identification method for estimating combined deterministic-stochastic LTI state-space models, is proposed. The algorithm is especially well-suited to identify hig…

State Space Modelssubspace methods

On the Acceleration of Deep Neural Network Inference using Quantized Compressed Sensing

2021-08-23 · Meshia Cédric Oveneke

Accelerating deep neural network (DNN) inference on resource-limited devices is one of the most important barriers to ensuring a wider and more inclusive adoption. To alleviate this, DNN binary quantization for faster co…

compressed sensingQuantization