paper-with-me

홈 › Papers

PAMS: Quantized Super-Resolution via Parameterized Max Scale

2020-11-09 · ECCV 2020 8 · Huixia Li, Chenqian Yan, Shaohui Lin, Xiawu Zheng, Yuchao Li, Baochang Zhang, Fan Yang, Rongrong Ji

Deep convolutional neural networks (DCNNs) have shown dominant performance in the task of super-resolution (SR). However, their heavy memory cost and computation overhead significantly restrict their practical deployments on resource-limited devices, which mainly arise from the floating-point storage and operations between weights and activations. Although previous endeavors mainly resort to fixed-point operations, quantizing both weights and activations with fixed coding lengths may cause significant performance drop, especially on low bits. Specifically, most state-of-the-art SR models without batch normalization have a large dynamic quantization range, which also serves as another cause of performance drop. To address these two issues, we propose a new quantization scheme termed PArameterized Max Scale (PAMS), which applies the trainable truncated parameter to explore the upper bound of the quantization range adaptively. Finally, a structured knowledge transfer (SKT) loss is introduced to fine-tune the quantized network. Extensive experiments demonstrate that the proposed PAMS scheme can well compress and accelerate the existing SR models such as EDSR and RDN. Notably, 8-bit PAMS-EDSR improves PSNR on Set5 benchmark from 32.095dB to 32.124dB with 2.42$\times$ compression ratio, which achieves a new state-of-the-art.

📄 PDF Abstract BibTeX arXiv:2011.04212

Code (1)

colorjam/PAMS pytorch

Tasks

QuantizationSuper-ResolutionTransfer Learning

Methods 이 논문이 사용한 방법론

Batch Normalization 설명 없음

Similar Papers 제목 키워드 기반

Analyzing Adaptive Parameter Landscapes in Parameter Adaptation Methods for Differential Evolution

2020-09-26 · Ryoji Tanabe

Since the scale factor and the crossover rate significantly influence the performance of differential evolution (DE), parameter adaptation methods (PAMs) for the two parameters have been well studied in the DE community.…

TPAM: A Simulation-Based Model for Quantitatively Analyzing Parameter Adaptation Methods

2020-10-05 · Ryoji Tanabe, Alex Fukunaga

While a large number of adaptive Differential Evolution (DE) algorithms have been proposed, their Parameter Adaptation Methods (PAMs) are not well understood. We propose a Target function-based PAM simulation (TPAM) fram…

PAMS: Platform for Artificial Market Simulations

2023-09-19 · Masanori Hirano, Ryosuke Takata, Kiyoshi Izumi

This paper presents a new artificial market simulation platform, PAMS: Platform for Artificial Market Simulations. PAMS is developed as a Python-based simulator that is easily integrated with deep learning and enabling v…

Deep Learning

Efficient and Accurate Quantized Image Super-Resolution on Mobile NPUs, Mobile AI & AIM 2022 challenge: Report

2022-11-07 · Andrey Ignatov, Radu Timofte, Maurizio Denna, Abdel Younes 외

Image super-resolution is a common task on mobile and IoT devices, where one often needs to upscale and enhance low-resolution images and video frames. While numerous solutions have been proposed for this problem in the …

Image Super-ResolutionSuper-Resolution

RTN: Reparameterized Ternary Network

2019-12-04 · Yuhang Li, Xin Dong, Sai Qian Zhang, Haoli Bai 외

To deploy deep neural networks on resource-limited devices, quantization has been widely explored. In this work, we study the extremely low-bit networks which have tremendous speed-up, memory saving with quantized activa…

Quantization