Deep Image Prior
Deep convolutional networks have become a popular tool for image generation and restoration. Generally, their excellent performance is imputed to their ability to learn realistic image priors from a large number of example images. In this paper, we show that, on the contrary, the structure of a generator network is sufficient to capture a great deal of low-level image statistics prior to any learning. In order to do so, we show that a randomly-initialized neural network can be used as a handcrafted prior with excellent results in standard inverse problems such as denoising, super-resolution, and inpainting. Furthermore, the same prior can be used to invert deep neural representations to diagnose them, and to restore images based on flash-no flash input pairs. Apart from its diverse applications, our approach highlights the inductive bias captured by standard generator network architectures. It also bridges the gap between two very popular families of image restoration methods: learning-based methods using deep convolutional networks and learning-free methods based on handcrafted image priors such as self-similarity. Code and supplementary material are available at https://dmitryulyanov.github.io/deep_image_prior .
Code (14)
Tasks
DenoisingFeature UpsamplingImage DenoisingImage GenerationImage InpaintingImage RestorationInductive BiasJpeg Compression Artifact ReductionSuper-ResolutionSimilar Papers 제목 키워드 기반
External Prior Guided Internal Prior Learning for Real-World Noisy Image Denoising
Most of existing image denoising methods learn image priors from either external data or the noisy image itself to remove noise. However, priors learned from external data may not be adaptive to the image to be denoised,…
DenoisingImage DenoisingImage Deblurring with a Class-Specific Prior
A fundamental problem in image deblurring is to recover reliably distinct spatial frequencies that have been suppressed by the blur kernel. To tackle this issue, existing image deblurring techniques often rely on generic…
DeblurringImage DeblurringEvent-horizon-scale Imaging of M87* under Different Assumptions via Deep Generative Image Priors
Reconstructing images from the Event Horizon Telescope (EHT) observations of M87*, the supermassive black hole at the center of the galaxy M87, depends on a prior to impose desired image statistics. However, given the im…
Bayesian InferenceImage ReconstructionSingle Image Haze Removal Using Dark Channel Prior
In this paper, we propose a simple but effective image prior-dark channel prior to remove haze from a single input image. The dark channel prior is a kind of statistics of outdoor haze-free images. It is based on a key o…
Single Image Haze RemovalLottery Image Prior
Deep Neural Networks (DNNs), either pre-trained (e.g., GAN generator) or untrained (e.g., deep image prior), could act as overparameterized image priors that help solve various image inverse problems. Since traditional i…
Compressive SensingImage ReconstructionImage Restoration