Deep Learning for Inverse Problems: Bounds and Regularizers
Inverse problems arise in a number of domains such as medical imaging, remote sensing, and many more, relying on the use of advanced signal and image processing approaches -- such as sparsity-driven techniques -- to determine their solution. This paper instead studies the use of deep learning approaches to approximate the solution of inverse problems. In particular, the paper provides a new generalization bound, depending on key quantity associated with a deep neural network -- its Jacobian matrix -- that also leads to a number of computationally efficient regularization strategies applicable to inverse problems. The paper also tests the proposed regularization strategies in a number of inverse problems including image super-resolution ones. Our numerical results conducted on various datasets show that both fully connected and convolutional neural networks regularized using the regularization or proxy regularization strategies originating from our theory exhibit much better performance than deep networks regularized with standard approaches such as weight-decay.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningImage Super-ResolutionSuper-ResolutionSimilar Papers 제목 키워드 기반
Learning sparsity-promoting regularizers for linear inverse problems
This paper introduces a novel approach to learning sparsity-promoting regularizers for solving linear inverse problems. We develop a bilevel optimization framework to select an optimal synthesis operator, denoted as $B$,…
Bilevel OptimizationTotal Deep Variation: A Stable Regularizer for Inverse Problems
Various problems in computer vision and medical imaging can be cast as inverse problems. A frequent method for solving inverse problems is the variational approach, which amounts to minimizing an energy composed of a dat…
DRIP: Deep Regularizers for Inverse Problems
In this paper we consider inverse problems that are mathematically ill-posed. That is, given some (noisy) data, there is more than one solution that approximately fits the data. In recent years, deep neural techniques th…
DeblurringImage DeblurringvalidDeep Equilibrium Learning of Explicit Regularizers for Imaging Inverse Problems
There has been significant recent interest in the use of deep learning for regularizing imaging inverse problems. Most work in the area has focused on regularization imposed implicitly by convolutional neural networks (C…
Image ReconstructionBanach Space Representer Theorems for Neural Networks and Ridge Splines
We develop a variational framework to understand the properties of the functions learned by neural networks fit to data. We propose and study a family of continuous-domain linear inverse problems with total variation-lik…