Regularising Inverse Problems with Generative Machine Learning Models
Deep neural network approaches to inverse imaging problems have produced impressive results in the last few years. In this paper, we consider the use of generative models in a variational regularisation approach to inverse problems. The considered regularisers penalise images that are far from the range of a generative model that has learned to produce images similar to a training dataset. We name this family \textit{generative regularisers}. The success of generative regularisers depends on the quality of the generative model and so we propose a set of desired criteria to assess generative models and guide future research. In our numerical experiments, we evaluate three common generative models, autoencoders, variational autoencoders and generative adversarial networks, against our desired criteria. We also test three different generative regularisers on the inverse problems of deblurring, deconvolution, and tomography. We show that restricting solutions of the inverse problem to lie exactly in the range of a generative model can give good results but that allowing small deviations from the range of the generator produces more consistent results.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningDeblurringSimilar Papers 제목 키워드 기반
On the Convergence of Stochastic Gradient Descent for Linear Inverse Problems in Banach Spaces
In this work we consider stochastic gradient descent (SGD) for solving linear inverse problems in Banach spaces. SGD and its variants have been established as one of the most successful optimisation methods in machine le…
Error Analysis of Bayesian Inverse Problems with Generative Priors
Data-driven methods for the solution of inverse problems have become widely popular in recent years thanks to the rise of machine learning techniques. A popular approach concerns the training of a generative model on add…
Preconditioned One-Step Generative Modeling for Bayesian Inverse Problems in Function Spaces
We propose a machine-learning algorithm for Bayesian inverse problems in the function-space regime. Based on one-step generative transport, the method learns an amortized neural operator whose pushforward of a Gaussian s…
Regularising Deep Networks with Deep Generative Models
We develop a new method for regularising neural networks. We learn a probability distribution over the activations of all layers of the model and then insert imputed values into the network during training. We obtain a p…
Data AugmentationImputationA Generative Diffusion Model to Solve Inverse Problems for Robust in-NICU Neonatal MRI
We present the first acquisition-agnostic diffusion generative model for Magnetic Resonance Imaging (MRI) in the neonatal intensive care unit (NICU) to solve a range of inverse problems for shortening scan time and impro…
Super-Resolution