paper-with-me

홈 › Papers

Compressing Deep Image Super-resolution Models

2023-12-31 · YuXuan Jiang, Jakub Nawala, Fan Zhang, David Bull

Deep learning techniques have been applied in the context of image super-resolution (SR), achieving remarkable advances in terms of reconstruction performance. Existing techniques typically employ highly complex model structures which result in large model sizes and slow inference speeds. This often leads to high energy consumption and restricts their adoption for practical applications. To address this issue, this work employs a three-stage workflow for compressing deep SR models which significantly reduces their memory requirement. Restoration performance has been maintained through teacher-student knowledge distillation using a newly designed distillation loss. We have applied this approach to two popular image super-resolution networks, SwinIR and EDSR, to demonstrate its effectiveness. The resulting compact models, SwinIRmini and EDSRmini, attain an 89% and 96% reduction in both model size and floating-point operations (FLOPs) respectively, compared to their original versions. They also retain competitive super-resolution performance compared to their original models and other commonly used SR approaches. The source code and pre-trained models for these two lightweight SR approaches are released at https://pikapi22.github.io/CDISM/.

📄 PDF Abstract BibTeX arXiv:2401.00523

Code (0)

등록된 구현이 없습니다.

Tasks

Image Super-ResolutionKnowledge DistillationSuper-Resolution

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

LCSCNet: Linear Compressing Based Skip-Connecting Network for Image Super-Resolution

2019-09-09 · Wenming Yang, Xuechen Zhang, Yapeng Tian, Wei Wang 외

In this paper, we develop a concise but efficient network architecture called linear compressing based skip-connecting network (LCSCNet) for image super-resolution. Compared with two representative network architectures …

Image Super-ResolutionSuper-Resolution

Lightweight super resolution network for point cloud geometry compression

2023-11-02 · Wei zhang, Dingquan Li, Ge Li, Wen Gao

This paper presents an approach for compressing point cloud geometry by leveraging a lightweight super-resolution network. The proposed method involves decomposing a point cloud into a base point cloud and the interpolat…

DecoderPoint cloud reconstructionPoint Cloud Super ResolutionSuper-Resolution

CondiQuant: Condition Number Based Low-Bit Quantization for Image Super-Resolution

2025-02-21 · Kai Liu, Dehui Wang, Zhiteng Li, Zheng Chen 외

Low-bit model quantization for image super-resolution (SR) is a longstanding task that is renowned for its surprising compression and acceleration ability. However, accuracy degradation is inevitable when compressing the…

Image Super-ResolutionQuantizationSuper-Resolution

Neuromorphologicaly-preserving Volumetric data encoding using VQ-VAE

2020-02-13 · MIDL 2019 7 · Petru-Daniel Tudosiu, Thomas Varsavsky, Richard Shaw, Mark Graham 외

The increasing efficiency and compactness of deep learning architectures, together with hardware improvements, have enabled the complex and high-dimensional modelling of medical volumetric data at higher resolutions. Rec…

Efficient Video Compression via Content-Adaptive Super-Resolution

2021-04-06 · ICCV 2021 10 · Mehrdad Khani, Vibhaalakshmi Sivaraman, Mohammad Alizadeh

Video compression is a critical component of Internet video delivery. Recent work has shown that deep learning techniques can rival or outperform human-designed algorithms, but these methods are significantly less comput…

GPUSuper-ResolutionVideo Compression