paper-with-me

홈 › Papers

Image denoising by Super Neurons: Why go deep?

2021-11-29 · Junaid Malik, Serkan Kiranyaz, Moncef Gabbouj

Classical image denoising methods utilize the non-local self-similarity principle to effectively recover image content from noisy images. Current state-of-the-art methods use deep convolutional neural networks (CNNs) to effectively learn the mapping from noisy to clean images. Deep denoising CNNs manifest a high learning capacity and integrate non-local information owing to the large receptive field yielded by numerous cascade of hidden layers. However, deep networks are also computationally complex and require large data for training. To address these issues, this study draws the focus on the Self-organized Operational Neural Networks (Self-ONNs) empowered by a novel neuron model that can achieve a similar or better denoising performance with a compact and shallow model. Recently, the concept of super-neurons has been introduced which augment the non-linear transformations of generative neurons by utilizing non-localized kernel locations for an enhanced receptive field size. This is the key accomplishment which renders the need for a deep network configuration. As the integration of non-local information is known to benefit denoising, in this work we investigate the use of super neurons for both synthetic and real-world image denoising. We also discuss the practical issues in implementing the super neuron model on GPUs and propose a trade-off between the heterogeneity of non-localized operations and computational complexity. Our results demonstrate that with the same width and depth, Self-ONNs with super neurons provide a significant boost of denoising performance over the networks with generative and convolutional neurons for both denoising tasks. Moreover, results demonstrate that Self-ONNs with super neurons can achieve a competitive and superior synthetic denoising performances than well-known deep CNN denoisers for synthetic and real-world denoising, respectively.

📄 PDF Abstract BibTeX arXiv:2111.14948

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingImage Denoising

Similar Papers 제목 키워드 기반

Rectifier Neural Network with a Dual-Pathway Architecture for Image Denoising

2016-09-10 · Keting Zhang, Liqing Zhang

Recently deep neural networks based on tanh activation function have shown their impressive power in image denoising. In this letter, we try to use rectifier function instead of tanh and propose a dual-pathway rectifier …

DenoisingImage Denoising

Quadratic Autoencoder (Q-AE) for Low-dose CT Denoising

2019-01-17 · Fenglei Fan, Hongming Shan, Mannudeep K. Kalra, Ramandeep Singh 외

Inspired by complexity and diversity of biological neurons, our group proposed quadratic neurons by replacing the inner product in current artificial neurons with a quadratic operation on input data, thereby enhancing th…

DecoderDeep LearningDenoisingDiversity+1

Neural Sparse Representation for Image Restoration

2020-06-08 · NeurIPS 2020 12 · Yuchen Fan, Jiahui Yu, Yiqun Mei, Yulun Zhang 외

Inspired by the robustness and efficiency of sparse representation in sparse coding based image restoration models, we investigate the sparsity of neurons in deep networks. Our method structurally enforces sparsity const…

DenoisingImage CompressionImage DenoisingImage Restoration+2

Neural information coding for efficient spike-based image denoising

2023-05-15 · Andrea Castagnetti, Alain Pegatoquet, Benoît Miramond

In recent years, Deep Convolutional Neural Networks (DCNNs) have outreached the performance of classical algorithms for image restoration tasks. However most of these methods are not suited for computational efficiency a…

Computational EfficiencyDenoisingImage DenoisingImage Restoration

Reducing Redundancy in the Bottleneck Representation of the Autoencoders

2022-02-09 · Firas Laakom, Jenni Raitoharju, Alexandros Iosifidis, Moncef Gabbouj

Autoencoders are a type of unsupervised neural networks, which can be used to solve various tasks, e.g., dimensionality reduction, image compression, and image denoising. An AE has two goals: (i) compress the original in…

DecoderDenoisingDimensionality ReductionImage Compression+1