Multi-level Encoder-Decoder Architectures for Image Restoration
Many real-world solutions for image restoration are learning-free and based on handcrafted image priors such as self-similarity. Recently, deep-learning methods that use training data have achieved state-of-the-art results in various image restoration tasks (e.g., super-resolution and inpainting). Ulyanov et al. bridge the gap between these two families of methods (CVPR 18). They have shown that learning-free methods perform close to the state-of-the-art learning-based methods (approximately 1 PSNR). Their approach benefits from the encoder-decoder network. In this paper, we propose a framework based on the multi-level extensions of the encoder-decoder network, to investigate interesting aspects of the relationship between image restoration and network construction independent of learning. Our framework allows various network structures by modifying the following network components: skip links, cascading of the network input into intermediate layers, a composition of the encoder-decoder subnetworks, and network depth. These handcrafted network structures illustrate how the construction of untrained networks influence the following image restoration tasks: denoising, super-resolution, and inpainting. We also demonstrate image reconstruction using flash and no-flash image pairs. We provide performance comparisons with the state-of-the-art methods for all the restoration tasks above.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderDenoisingImage ReconstructionImage RestorationSuper-ResolutionSimilar Papers 제목 키워드 기반
QTSeg: A Query Token-Based Architecture for Efficient 2D Medical Image Segmentation
Medical image segmentation is crucial in assisting medical doctors in making diagnoses and enabling accurate automatic diagnosis. While advanced convolutional neural networks (CNNs) excel in segmenting regions of interes…
Breast Cancer DetectionDecoderImage SegmentationMedical Image Segmentation+2Cascade Decoders-Based Autoencoders for Image Reconstruction
Autoencoders are composed of coding and decoding units, hence they hold the inherent potential of high-performance data compression and signal compressed sensing. The main disadvantages of current autoencoders comprise t…
compressed sensingData CompressionImage CompressionImage ReconstructionMixSearch: Searching for Domain Generalized Medical Image Segmentation Architectures
Considering the scarcity of medical data, most datasets in medical image analysis are an order of magnitude smaller than those of natural images. However, most Network Architecture Search (NAS) approaches in medical imag…
DecoderImage SegmentationMedical Image AnalysisMedical Image Segmentation+2Does Your ViT Still Need U-Net for Segmentation?
Medical image segmentation is dominated by U-Net-style encoder-decoder architectures. Vision Transformers (ViTs) overcome the limited receptive field of convolutional networks through self-attention, enabling modeling of…
Medical Image SegmentationModel Guidance via Explanations Turns Image Classifiers into Segmentation Models
Heatmaps generated on inputs of image classification networks via explainable AI methods like Grad-CAM and LRP have been observed to resemble segmentations of input images in many cases. Consequently, heatmaps have also …
Decoderimage-classificationImage ClassificationImage Segmentation+3