Compressing Deep Image Super-resolution Models
Deep learning techniques have been applied in the context of image super-resolution (SR), achieving remarkable advances in terms of reconstruction performance. Existing techniques typically employ highly complex model structures which result in large model sizes and slow inference speeds. This often leads to high energy consumption and restricts their adoption for practical applications. To address this issue, this work employs a three-stage workflow for compressing deep SR models which significantly reduces their memory requirement. Restoration performance has been maintained through teacher-student knowledge distillation using a newly designed distillation loss. We have applied this approach to two popular image super-resolution networks, SwinIR and EDSR, to demonstrate its effectiveness. The resulting compact models, SwinIRmini and EDSRmini, attain an 89% and 96% reduction in both model size and floating-point operations (FLOPs) respectively, compared to their original versions. They also retain competitive super-resolution performance compared to their original models and other commonly used SR approaches. The source code and pre-trained models for these two lightweight SR approaches are released at https://pikapi22.github.io/CDISM/.
Code (0)
등록된 구현이 없습니다.
Tasks
Image Super-ResolutionKnowledge DistillationSuper-ResolutionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
LCSCNet: Linear Compressing Based Skip-Connecting Network for Image Super-Resolution
In this paper, we develop a concise but efficient network architecture called linear compressing based skip-connecting network (LCSCNet) for image super-resolution. Compared with two representative network architectures …
Image Super-ResolutionSuper-ResolutionLightweight super resolution network for point cloud geometry compression
This paper presents an approach for compressing point cloud geometry by leveraging a lightweight super-resolution network. The proposed method involves decomposing a point cloud into a base point cloud and the interpolat…
DecoderPoint cloud reconstructionPoint Cloud Super ResolutionSuper-ResolutionCondiQuant: Condition Number Based Low-Bit Quantization for Image Super-Resolution
Low-bit model quantization for image super-resolution (SR) is a longstanding task that is renowned for its surprising compression and acceleration ability. However, accuracy degradation is inevitable when compressing the…
Image Super-ResolutionQuantizationSuper-ResolutionNeuromorphologicaly-preserving Volumetric data encoding using VQ-VAE
The increasing efficiency and compactness of deep learning architectures, together with hardware improvements, have enabled the complex and high-dimensional modelling of medical volumetric data at higher resolutions. Rec…
Efficient Video Compression via Content-Adaptive Super-Resolution
Video compression is a critical component of Internet video delivery. Recent work has shown that deep learning techniques can rival or outperform human-designed algorithms, but these methods are significantly less comput…
GPUSuper-ResolutionVideo Compression