paper-with-me

Papers

Involution and BSConv Multi-Depth Distillation Network for Lightweight Image Super-Resolution

2025-03-18 · Akram Khatami-Rizi, Ahmad Mahmoudi-Aznaveh

Single Image Super-Resolution (SISR) aims to reconstruct high-resolution (HR) images from low-resolution (LR) inputs. Deep learning, especially Convolutional Neural Networks (CNNs), has advanced SISR. However, increasing network depth increases parameters, and memory usage, and slows training, which is problematic for resource-limited devices. To address this, lightweight models are developed to balance accuracy and efficiency. We propose the Involution & BSConv Multi-Depth Distillation Network (IBMDN), combining Involution & BSConv Multi-Depth Distillation Block (IBMDB) and the Contrast and High-Frequency Attention Block (CHFAB). IBMDB integrates Involution and BSConv to balance computational efficiency and feature extraction. CHFAB enhances high-frequency details for better visual quality. IBMDB is compatible with other SISR architectures and reduces complexity, improving evaluation metrics like PSNR and SSIM. In transformer-based models, IBMDB reduces memory usage while improving feature extraction. In GANs, it enhances perceptual quality, balancing pixel-level accuracy with perceptual details. Our experiments show that the method achieves high accuracy with minimal computational cost. The code is available at GitHub.

📄 PDF Abstract BibTeX arXiv:2503.14779

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyImage Super-ResolutionSSIMSuper-Resolution

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Involution Involution is an atomic operation for deep neural networks that inverts the design principles of convolution. Involution kernels are distinct in the spatial extent but shared…

Similar Papers 제목 키워드 기반

Rethinking Depthwise Separable Convolutions: How Intra-Kernel Correlations Lead to Improved MobileNets

2020-03-30 · CVPR 2020 6 · Daniel Haase, Manuel Amthor

We introduce blueprint separable convolutions (BSConv) as highly efficient building blocks for CNNs. They are motivated by quantitative analyses of kernel properties from trained models, which show the dominance of corre…

Fine-Grained Image ClassificationImage Classification

Large coordinate kernel attention network for lightweight image super-resolution

2024-05-15 · Fangwei Hao, Jiesheng Wu, Haotian Lu, Ji Du 외

The multi-scale receptive field and large kernel attention (LKA) module have been shown to significantly improve performance in the lightweight image super-resolution task. However, existing lightweight super-resolution …

Image Super-ResolutionSuper-Resolution

SLVR: Super-Light Visual Reconstruction via Blueprint Controllable Convolutions and Exploring Feature Diversity Representation

2025-01-01 · CVPR 2025 1 · Ning Ni, Libao Zhang

Recently, improving the residual structure and designing efficient convolutions have become important branches of lightweight visual reconstruction model design. We have observed that the feature addition mode (FAM) …

DiversitySuper-Resolution

Co-advise: Cross Inductive Bias Distillation

2021-06-23 · CVPR 2022 1 · Sucheng Ren, Zhengqi Gao, Tianyu Hua, Zihui Xue 외

Transformers recently are adapted from the community of natural language processing as a promising substitute of convolution-based neural networks for visual learning tasks. However, its supremacy degenerates given an in…

Inductive Bias

Distilling Inductive Bias: Knowledge Distillation Beyond Model Compression

2023-09-30 · Gousia Habib, Tausifa Jan Saleem, Brejesh lall

With the rapid development of computer vision, Vision Transformers (ViTs) offer the tantalizing prospect of unified information processing across visual and textual domains. But due to the lack of inherent inductive bias…

Inductive BiasKnowledge DistillationmodelModel Compression