paper-with-me

Papers

Faster gradient descent and the efficient recovery of images

2013-08-12 · Hui Huang, Uri Ascher

Much recent attention has been devoted to gradient descent algorithms where the steepest descent step size is replaced by a similar one from a previous iteration or gets updated only once every second step, thus forming a {\em faster gradient descent method}. For unconstrained convex quadratic optimization these methods can converge much faster than steepest descent. But the context of interest here is application to certain ill-posed inverse problems, where the steepest descent method is known to have a smoothing, regularizing effect, and where a strict optimization solution is not necessary. Specifically, in this paper we examine the effect of replacing steepest descent by a faster gradient descent algorithm in the practical context of image deblurring and denoising tasks. We also propose several highly efficient schemes for carrying out these tasks independently of the step size selection, as well as a scheme for the case where both blur and significant noise are present. In the above context there are situations where many steepest descent steps are required, thus building slowness into the solution procedure. Our general conclusion regarding gradient descent methods is that in such cases the faster gradient descent methods offer substantial advantages. In other situations where no such slowness buildup arises the steepest descent method can still be very effective.

📄 PDF Abstract BibTeX arXiv:1308.2464

Code (0)

등록된 구현이 없습니다.

Tasks

DeblurringDenoisingImage Deblurring

Similar Papers 제목 키워드 기반

Fast off-the-grid sparse recovery with over-parametrized projected gradient descent

2022-02-28 · Pierre-Jean Bénard, Yann Traonmilin, Jean-François Aujol

We consider the problem of recovering off-the-grid spikes from Fourier measurements. Successful methods such as sliding Frank-Wolfe and continuous orthogonal matching pursuit (OMP) iteratively add spikes to the solution …

Denoising and Regularization via Exploiting the Structural Bias of Convolutional Generators

2019-10-31 · ICLR 2020 1 · Reinhard Heckel, Mahdi Soltanolkotabi

Convolutional Neural Networks (CNNs) have emerged as highly successful tools for image generation, recovery, and restoration. A major contributing factor to this success is that convolutional networks impose strong prior…

AttributeDenoisingImage Generation

Robust Recovery via Implicit Bias of Discrepant Learning Rates for Double Over-parameterization

2020-06-16 · NeurIPS 2020 12 · Chong You, Zhihui Zhu, Qing Qu, Yi Ma

Recent advances have shown that implicit bias of gradient descent on over-parameterized models enables the recovery of low-rank matrices from linear measurements, even with no prior knowledge on the intrinsic rank. In co…

Learning Iterative Neural Optimizers for Image Steganography

2023-03-27 · Xiangyu Chen, Varsha Kishore, Kilian Q Weinberger

Image steganography is the process of concealing secret information in images through imperceptible changes. Recent work has formulated this task as a classic constrained optimization problem. In this paper, we argue tha…

DecoderImage Steganography

Recovery Guarantees of Unsupervised Neural Networks for Inverse Problems trained with Gradient Descent

2024-03-08 · Nathan Buskulic, Jalal Fadili, Yvain Quéau

Advanced machine learning methods, and more prominently neural networks, have become standard to solve inverse problems over the last years. However, the theoretical recovery guarantees of such methods are still scarce a…