paper-with-me

Papers

Dynamic Slimmable Denoising Network

2021-10-17 · Zutao Jiang, Changlin Li, Xiaojun Chang, Jihua Zhu, Yi Yang

Recently, tremendous human-designed and automatically searched neural networks have been applied to image denoising. However, previous works intend to handle all noisy images in a pre-defined static network architecture, which inevitably leads to high computational complexity for good denoising quality. Here, we present dynamic slimmable denoising network (DDS-Net), a general method to achieve good denoising quality with less computational complexity, via dynamically adjusting the channel configurations of networks at test time with respect to different noisy images. Our DDS-Net is empowered with the ability of dynamic inference by a dynamic gate, which can predictively adjust the channel configuration of networks with negligible extra computation cost. To ensure the performance of each candidate sub-network and the fairness of the dynamic gate, we propose a three-stage optimization scheme. In the first stage, we train a weight-shared slimmable super network. In the second stage, we evaluate the trained slimmable super network in an iterative way and progressively tailor the channel numbers of each layer with minimal denoising quality drop. By a single pass, we can obtain several sub-networks with good performance under different channel configurations. In the last stage, we identify easy and hard samples in an online way and train a dynamic gate to predictively select the corresponding sub-network with respect to different noisy images. Extensive experiments demonstrate our DDS-Net consistently outperforms the state-of-the-art individually trained static denoising networks.

📄 PDF Abstract BibTeX arXiv:2110.08940

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingFairnessImage Denoising

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Slimmable Video Codec

2022-05-13 · Zhaocheng Liu, Luis Herranz, Fei Yang, Saiping Zhang 외

Neural video compression has emerged as a novel paradigm combining trainable multilayer neural networks and machine learning, achieving competitive rate-distortion (RD) performances, but still remaining impractical due t…

Video Compression

Three Guidelines You Should Know for Universally Slimmable Self-Supervised Learning

2023-03-13 · CVPR 2023 1 · Yun-Hao Cao, Peiqin Sun, Shuchang Zhou

We propose universally slimmable self-supervised learning (dubbed as US3L) to achieve better accuracy-efficiency trade-offs for deploying self-supervised models across different devices. We observe that direct adaptation…

Instance Segmentationobject-detectionObject DetectionSelf-Supervised Learning+1

Slimmable Quantum Federated Learning

2022-07-20 · Won Joon Yun, Jae Pyoung Kim, Soyi Jung, Jihong Park 외

Quantum federated learning (QFL) has recently received increasing attention, where quantum neural networks (QNNs) are integrated into federated learning (FL). In contrast to the existing static QFL methods, we propose sl…

Federated Learning

Universally Slimmable Networks and Improved Training Techniques

2019-03-12 · ICCV 2019 10 · Jiahui Yu, Thomas Huang

Slimmable networks are a family of neural networks that can instantly adjust the runtime width. The width can be chosen from a predefined widths set to adaptively optimize accuracy-efficiency trade-offs at runtime. In th…

Deep Reinforcement LearningImage Super-ResolutionReinforcement LearningSuper-Resolution

Small-footprint slimmable networks for keyword spotting

2023-04-21 · Zuhaib Akhtar, Mohammad Omar Khursheed, Dongsu Du, Yuzong Liu

In this work, we present Slimmable Neural Networks applied to the problem of small-footprint keyword spotting. We show that slimmable neural networks allow us to create super-nets from Convolutioanl Neural Networks and T…

Keyword SpottingSmall-Footprint Keyword Spotting