paper-with-me

홈 › Papers

Learnable Descent Algorithm for Nonsmooth Nonconvex Image Reconstruction

2020-07-22 · Yunmei Chen, Hongcheng Liu, Xiaojing Ye, Qingchao Zhang

We propose a general learning based framework for solving nonsmooth and nonconvex image reconstruction problems. We model the regularization function as the composition of the $l_{2,1}$ norm and a smooth but nonconvex feature mapping parametrized as a deep convolutional neural network. We develop a provably convergent descent-type algorithm to solve the nonsmooth nonconvex minimization problem by leveraging the Nesterov's smoothing technique and the idea of residual learning, and learn the network parameters such that the outputs of the algorithm match the references in training data. Our method is versatile as one can employ various modern network structures into the regularization, and the resulting network inherits the guaranteed convergence of the algorithm. We also show that the proposed network is parameter-efficient and its performance compares favorably to the state-of-the-art methods in a variety of image reconstruction problems in practice.

📄 PDF Abstract BibTeX arXiv:2007.11245

Code (0)

등록된 구현이 없습니다.

Tasks

Image Reconstruction

Similar Papers 제목 키워드 기반

A Novel Learnable Gradient Descent Type Algorithm for Non-convex Non-smooth Inverse Problems

2020-03-15 · Qingchao Zhang, Xiaojing Ye, Hongcheng Liu, Yun-Mei Chen

Optimization algorithms for solving nonconvex inverse problem have attracted significant interests recently. However, existing methods require the nonconvex regularization to be smooth or simple to ensure convergence. In…

Image Reconstruction

Asynchronous Delay-Aware Accelerated Proximal Coordinate Descent for Nonconvex Nonsmooth Problems

2019-02-05 · Ehsan Kazemi, Liqiang Wang

Nonconvex and nonsmooth problems have recently attracted considerable attention in machine learning. However, developing efficient methods for the nonconvex and nonsmooth optimization problems with certain performance gu…

Fast Stochastic Methods for Nonsmooth Nonconvex Optimization

2016-05-23 · Sashank J. Reddi, Suvrit Sra, Barnabas Poczos, Alex Smola

We analyze stochastic algorithms for optimizing nonconvex, nonsmooth finite-sum problems, where the nonconvex part is smooth and the nonsmooth part is convex. Surprisingly, unlike the smooth case, our knowledge of this f…

Projective Proximal Gradient Descent for A Class of Nonconvex Nonsmooth Optimization Problems: Fast Convergence Without Kurdyka-Lojasiewicz (KL) Property

2023-04-20 · Yingzhen Yang, Ping Li

Nonconvex and nonsmooth optimization problems are important and challenging for statistics and machine learning. In this paper, we propose Projected Proximal Gradient Descent (PPGD) which solves a class of nonconvex and …

Proximal Stochastic Methods for Nonsmooth Nonconvex Finite-Sum Optimization

2016-12-01 · NeurIPS 2016 12 · Sashank J. Reddi, Suvrit Sra, Barnabas Poczos, Alexander J. Smola

We analyze stochastic algorithms for optimizing nonconvex, nonsmooth finite-sum problems, where the nonsmooth part is convex. Surprisingly, unlike the smooth case, our knowledge of this fundamental problem is very limit…