paper-with-me

홈 › Papers

Real Image Denoising with Knowledge Distillation for High-Performance Mobile NPUs

2026-05-05 · Faraz Kayani, Sarmad Kayani, Asad Ahmed, Radu Timofte, Dmitry Ignatov arxiv

While deep-learning-based image restoration has achieved unprecedented fidelity, deployment on mobile Neural Processing Units (NPUs) remains bottlenecked by operator incompatibility and memory-access overhead. We propose an NPU-aware hardware-algorithm co-design approach for real-world image denoising on mobile NPUs. Our approach employs a high-capacity teacher to supervise a lightweight student network specifically designed to leverage the tiled-memory architectures of modern mobile SoCs. By prioritizing NPU-native primitives -- standard 3x3 convolutions, ReLU activations, and nearest-neighbor upsampling -- and employing a progressive context expansion strategy (up to 1024x1024 crops), the model achieves 37.66 dB PSNR / 0.9278 SSIM on the validation benchmark and 37.58 dB PSNR / 0.9098 SSIM on the held-out test benchmark at full resolution (2432x3200) in the Mobile AI 2026 challenge. Following the official challenge rules, the inference runtime is measured under a standardized Full HD (1088x1920) protocol, where it runs in 34.0 ms on the MediaTek Dimensity 9500 and 46.1 ms on the Qualcomm Snapdragon 8 Elite NPU. We further reveal an "Inference Inversion" effect, where strict adherence to NPU-compatible operations enables dedicated NPU execution up to 3.88x faster than the integrated mobile GPU. The 1.96M-parameter student recovers 99.8% of the teacher's restoration quality via high-alpha knowledge distillation (alpha = 0.9), achieving a 21.2x parameter reduction while closing the PSNR gap from 1.63 dB to only 0.05 dB. These results establish hardware-aware distillation as an effective strategy for unifying high-fidelity denoising with practical deployment across diverse mobile NPU architectures. The proposed lightweight student model (LiteDenoiseNet) and its training statistics are provided in the NN Dataset, available at https://github.com/ABrain-One/NN-Dataset.

📄 PDF Abstract BibTeX arXiv:2605.03680

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge DistillationImage RestorationImage Denoising

Similar Papers 제목 키워드 기반

Unpaired Learning of Deep Image Denoising

2020-08-31 · ECCV 2020 8 · Xiaohe Wu, Ming Liu, Yue Cao, Dongwei Ren 외

We investigate the task of learning blind image denoising networks from an unpaired set of clean and noisy images. Such problem setting generally is practical and valuable considering that it is feasible to collect unpai…

DenoisingImage DenoisingKnowledge DistillationSelf-Supervised Learning

Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed

2021-01-07 · Eric Luhman, Troy Luhman

Iterative generative models, such as noise conditional score networks and denoising diffusion probabilistic models, produce high quality samples by gradually denoising an initial noise vector. However, their denoising pr…

DenoisingImage GenerationKnowledge Distillation

Feature-Align Network with Knowledge Distillation for Efficient Denoising

2021-03-02 · Lucas D. Young, Fitsum A. Reda, Rakesh Ranjan, Jon Morton 외

We propose an efficient neural network for RAW image denoising. Although neural network-based denoising has been extensively studied for image restoration, little attention has been given to efficient denoising for compu…

DecoderDenoisingEfficient Neural NetworkImage Denoising+2

LiteKD-Net: Lightweight Knowledge-Distilled Network for Mobile Image Denoising

2026-08-06 · Zhou Zhiyi arxiv

Mobile image denoising requires both good restoration quality and low computational cost. In addition, it's annoying to collect large-scale LQ-GT clean pairs. As a result, we propose LiteKD-Net, a lightweight knowledge-d…

Computational EfficiencyKnowledge DistillationImage Denoising

PocketDVDNet: Realtime Video Denoising for Real Camera Noise

2026-01-23 · Crispian Morris, Imogen Dexter, Fan Zhang, David R. Bull 외 arxiv

Live video denoising under realistic, multi-component sensor noise remains challenging for applications such as autofocus, autonomous driving, and surveillance. We propose PocketDVDNet, a lightweight video denoiser devel…

Knowledge DistillationAutonomous DrivingModel CompressionVideo Denoising