Not All Ops Are Created Equal!
Efficient and compact neural network models are essential for enabling the deployment on mobile and embedded devices. In this work, we point out that typical design metrics for gauging the efficiency of neural network architectures -- total number of operations and parameters -- are not sufficient. These metrics may not accurately correlate with the actual deployment metrics such as energy and memory footprint. We show that throughput and energy varies by up to 5X across different neural network operation types on an off-the-shelf Arm Cortex-M7 microcontroller. Furthermore, we show that the memory required for activation data also need to be considered, apart from the model parameters, for network architecture exploration studies.
Code (0)
등록된 구현이 없습니다.
Tasks
AllSimilar Papers 제목 키워드 기반
Not All Character N-grams Are Created Equal: A Study in Authorship Attribution
Not All Titles are Created Equal: Financial Document Structure Extraction Shared Task
Not All Contexts Are Created Equal: Better Word Representations with Variable Attention
Identifying Computer-Translated Paragraphs using Coherence Features
We have developed a method for extracting the coherence features from a paragraph by matching similar words in its sentences. We conducted an experiment with a parallel German corpus containing 2000 human-created and 200…
Paper generationTranslationEnhancing Recommender System Performance by Histogram Equalization
Recommender system has been researched for decades with millions of different versions of algorithms created in the industry. In spite of the huge amount of work spent on the field, there are many basic questions to be a…
FairnessRecommendation Systems