Architecture Aware Latency Constrained Sparse Neural Networks

2021-09-01 · Tianli Zhao, Qinghao Hu, Xiangyu He, Weixiang Xu, Jiaxing Wang, Cong Leng, Jian Cheng

Acceleration of deep neural networks to meet a specific latency constraint is essential for their deployment on mobile devices. In this paper, we design an architecture aware latency constrained sparse (ALCS) framework to prune and accelerate CNN models. Taking modern mobile computation architectures into consideration, we propose Single Instruction Multiple Data (SIMD)-structured pruning, along with a novel sparse convolution algorithm for efficient computation. Besides, we propose to estimate the run time of sparse models with piece-wise linear interpolation. The whole latency constrained pruning task is formulated as a constrained optimization problem that can be efficiently solved with Alternating Direction Method of Multipliers (ADMM). Extensive experiments show that our system-algorithm co-design framework can achieve much better Pareto frontier among network accuracy and latency on resource-constrained mobile devices.

📄 PDF Abstract BibTeX arXiv:2109.00170

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Pruning 설명 없음

AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

SONIC: A Sparse Neural Network Inference Accelerator with Silicon Photonics for Energy-Efficient Deep Learning

2021-09-09 · Febin Sunny, Mahdi Nikdast, Sudeep Pasricha

Sparse neural networks can greatly facilitate the deployment of neural networks on resource-constrained platforms as they offer compact model sizes while retaining inference accuracy. Because of the sparsity in parameter…

MicroNAS: Memory and Latency Constrained Hardware-Aware Neural Architecture Search for Time Series Classification on Microcontrollers

2023-10-27 · Tobias King, Yexu Zhou, Tobias Röddiger, Michael Beigl

Designing domain specific neural networks is a time-consuming, error-prone, and expensive task. Neural Architecture Search (NAS) exists to simplify domain-specific model development but there is a gap in the literature f…

Hardware Aware Neural Architecture Search Neural Architecture Search Time Series Time Series Classification

Latency-aware Human-in-the-Loop Reinforcement Learning for Semantic Communications

2026-02-17 · Peizheng Li, Xinyi Lin, Adnan Aijaz arxiv

Semantic communication promises task-aligned transmission but must reconcile semantic fidelity with stringent latency guarantees in immersive and safety-critical services. This paper introduces a time-constrained human-i…

Reinforcement Learning Semantic Communication

Accelerating Linear Recurrent Neural Networks for the Edge with Unstructured Sparsity

2025-02-03 · Alessandro Pierro, Steven Abreu, Jonathan Timcheck, Philipp Stratmann 외

Linear recurrent neural networks enable powerful long-range sequence modeling with constant memory usage and time-per-token during inference. These architectures hold promise for streaming applications at the edge, but d…

Audio Denoising Denoising GPU Model Compression

MnasFPN: Learning Latency-aware Pyramid Architecture for Object Detection on Mobile Devices

2019-12-02 · CVPR 2020 6 · Bo Chen, Golnaz Ghiasi, Hanxiao Liu, Tsung-Yi Lin 외

Despite the blooming success of architecture search for vision tasks in resource-constrained environments, the design of on-device object detection architectures have mostly been manual. The few automated search efforts …

object-detection Object Detection