Adaptive Pixel-wise Structured Sparse Network for Efficient CNNs
To accelerate deep CNN models, this paper proposes a novel spatially adaptive framework that can dynamically generate pixel-wise sparsity according to the input image. The sparse scheme is pixel-wise refined, regional adaptive under a unified importance map, which makes it friendly to hardware implementation. A sparse controlling method is further presented to enable online adjustment for applications with different precision/latency requirements. The sparse model is applicable to a wide range of vision tasks. Experimental results show that this method efficiently improve the computing efficiency for both image classification using ResNet-18 and super resolution using SRResNet. On image classification task, our method can save 30%-70% MACs with a slightly drop in top-1 and top-5 accuracy. On super resolution task, our method can reduce more than 90% MACs while only causing around 0.1 dB and 0.01 decreasing in PSNR and SSIM. Hardware validation is also included.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingGeneral Classificationimage-classificationImage ClassificationImage DenoisingSSIMStyle TransferSuper-ResolutionSimilar Papers 제목 키워드 기반
Structured Priors for Sparse-Representation-Based Hyperspectral Image Classification
Pixel-wise classification, where each pixel is assigned to a predefined class, is one of the most important procedures in hyperspectral image (HSI) analysis. By representing a test pixel as a linear combination of a smal…
ClassificationGeneral ClassificationHyperspectral Image Classificationimage-classification+1A Versatile Framework for Designing Group-Sparse Adversarial Attacks
Existing adversarial attacks often neglect perturbation sparsity, limiting their ability to model structural changes and to explain how deep neural networks (DNNs) process meaningful input patterns. We propose ATOS (Atta…
PSGR: Pixel-wise Sparse Graph Reasoning for COVID-19 Pneumonia Segmentation in CT Images
Automated and accurate segmentation of the infected regions in computed tomography (CT) images is critical for the prediction of the pathological stage and treatment response of COVID-19. Several deep convolutional neura…
Computed Tomography (CT)graph constructionInformation RetrievalRetrieval+1Learning Propagation for Arbitrarily-structured Data
Processing an input signal that contains arbitrary structures, e.g., superpixels and point clouds, remains a big challenge in computer vision. Linear diffusion, an effective model for image processing, has been recently …
Point Cloud SegmentationSegmentationSemantic SegmentationSuperpixelsPropagating Confidences through CNNs for Sparse Data Regression
In most computer vision applications, convolutional neural networks (CNNs) operate on dense image data generated by ordinary cameras. Designing CNNs for sparse and irregularly spaced input data is still an open problem w…
Autonomous DrivingDepth Completionregression