Low Shot Learning with Untrained Neural Networks for Imaging Inverse Problems
Employing deep neural networks as natural image priors to solve inverse problems either requires large amounts of data to sufficiently train expressive generative models or can succeed with no data via untrained neural networks. However, very few works have considered how to interpolate between these no- to high-data regimes. In particular, how can one use the availability of a small amount of data (even $5-25$ examples) to one's advantage in solving these inverse problems and can a system's performance increase as the amount of data increases as well? In this work, we consider solving linear inverse problems when given a small number of examples of images that are drawn from the same distribution as the image of interest. Comparing to untrained neural networks that use no data, we show how one can pre-train a neural network with a few given examples to improve reconstruction results in compressed sensing and semantic image recovery problems such as colorization. Our approach leads to improved reconstruction as the amount of available data increases and is on par with fully trained generative models, while requiring less than $1 \%$ of the data needed to train a generative model.
Code (0)
등록된 구현이 없습니다.
Tasks
Colorizationcompressed sensingSimilar Papers 제목 키워드 기반
Towards Lensless Image Deblurring with Prior-Embedded Implicit Neural Representations in the Low-Data Regime
The field of computational imaging has witnessed a promising paradigm shift with the emergence of untrained neural networks, offering novel solutions to inverse computational imaging problems. While existing techniques h…
DeblurringImage DeblurringImage ReconstructionAlgorithmic Guarantees for Inverse Imaging with Untrained Network Priors
Deep neural networks as image priors have been recently introduced for problems such as denoising, super-resolution and inpainting with promising performance gains over hand-crafted image priors such as sparsity and low-…
Compressive SensingDenoisingRetrievalSuper-ResolutionUntrained networks for compressive lensless photography
Compressive lensless imagers enable novel applications in an extremely compact device, requiring only a phase or amplitude mask placed close to the sensor. They have been demonstrated for 2D and 3D microscopy, single-sho…
Compressive SensingPhase Retrieval using Untrained Neural Network Priors
Untrained deep neural networks as image priors have been recently introduced for linear inverse imaging problems such as denoising, super-resolution, inpainting and compressive sensing with promising performance gains o…
Compressive SensingDenoisingRetrievalSuper-ResolutionMetaDIP: Accelerating Deep Image Prior with Meta Learning
Deep image prior (DIP) is a recently proposed technique for solving imaging inverse problems by fitting the reconstructed images to the output of an untrained convolutional neural network. Unlike pretrained feedforward n…
DenoisingMeta-LearningRetrieval