Bandwidth-efficient Inference for Neural Image Compression
With neural networks growing deeper and feature maps growing larger, limited communication bandwidth with external memory (or DRAM) and power constraints become a bottleneck in implementing network inference on mobile and edge devices. In this paper, we propose an end-to-end differentiable bandwidth efficient neural inference method with the activation compressed by neural data compression method. Specifically, we propose a transform-quantization-entropy coding pipeline for activation compression with symmetric exponential Golomb coding and a data-dependent Gaussian entropy model for arithmetic coding. Optimized with existing model quantization methods, low-level task of image compression can achieve up to 19x bandwidth reduction with 6.21x energy saving.
Code (0)
등록된 구현이 없습니다.
Tasks
Data CompressionImage CompressionQuantizationSimilar Papers 제목 키워드 기반
Progressive Neural Compression for Adaptive Image Offloading under Timing Constraints
IoT devices are increasingly the source of data for machine learning (ML) applications running on edge servers. Data transmissions from devices to servers are often over local wireless networks whose bandwidth is not jus…
image-classificationImage ClassificationDeepAdaIn-Net: Deep Adaptive Device-Edge Collaborative Inference for Augmented Reality
The object inference for augmented reality (AR) requires a precise object localization within user's physical environment and the adaptability to dynamic communication conditions. Deep learning (DL) is advantageous in ca…
Collaborative InferenceFeature CompressionObjectObject LocalizationDynaFilter: Cloud-driven Dynamic Filtering for Satellite Edge Intelligence
Modern satellite edge systems, including those performing remote sensing tasks such object detection and tracking, are characterized by severely limited bandwidth and intermittent connections, making continuous data tran…
Object DetectionTowards Image Understanding from Deep Compression without Decoding
Motivated by recent work on deep neural network (DNN)-based image compression methods showing potential improvements in image quality, savings in storage, and bandwidth reduction, we propose to perform image understandin…
ClassificationGeneral ClassificationImage CompressionSegmentationCAT: Compression-Aware Training for bandwidth reduction
Convolutional neural networks (CNNs) have become the dominant neural network architecture for solving visual processing tasks. One of the major obstacles hindering the ubiquitous use of CNNs for inference is their relati…
Quantization