paper-with-me

Papers

Projected Nesterov's Proximal-Gradient Algorithm for Sparse Signal Reconstruction with a Convex Constraint

2015-02-09 · Renliang Gu, Aleksandar Dogandžić

We develop a projected Nesterov's proximal-gradient (PNPG) approach for sparse signal reconstruction that combines adaptive step size with Nesterov's momentum acceleration. The objective function that we wish to minimize is the sum of a convex differentiable data-fidelity (negative log-likelihood (NLL)) term and a convex regularization term. We apply sparse signal regularization where the signal belongs to a closed convex set within the closure of the domain of the NLL; the convex-set constraint facilitates flexible NLL domains and accurate signal recovery. Signal sparsity is imposed using the $\ell_1$-norm penalty on the signal's linear transform coefficients or gradient map, respectively. The PNPG approach employs projected Nesterov's acceleration step with restart and an inner iteration to compute the proximal mapping. We propose an adaptive step-size selection scheme to obtain a good local majorizing function of the NLL and reduce the time spent backtracking. Thanks to step-size adaptation, PNPG does not require Lipschitz continuity of the gradient of the NLL. We present an integrated derivation of the momentum acceleration and its $\mathcal{O}(k^{-2})$ convergence-rate and iterate convergence proofs, which account for adaptive step-size selection, inexactness of the iterative proximal mapping, and the convex-set constraint. The tuning of PNPG is largely application-independent. Tomographic and compressed-sensing reconstruction experiments with Poisson generalized linear and Gaussian linear measurement models demonstrate the performance of the proposed approach.

📄 PDF Abstract BibTeX arXiv:1502.02613

Code (0)

등록된 구현이 없습니다.

Tasks

compressed sensing

Similar Papers 제목 키워드 기반

Inexact Proximal Gradient Methods for Non-convex and Non-smooth Optimization

2016-12-18 · Bin Gu, De Wang, Zhouyuan Huo, Heng Huang

In machine learning research, the proximal gradient methods are popular for solving various optimization problems with non-smooth regularization. Inexact proximal gradient methods are extremely important when exactly sol…

BIG-bench Machine Learning

GSE: Group-wise Sparse and Explainable Adversarial Attacks

2023-11-29 · Shpresim Sadiku, Moritz Wagner, Sebastian Pokutta

Sparse adversarial attacks fool deep neural networks (DNNs) through minimal pixel perturbations, often regularized by the $\ell_0$ norm. Recent efforts have replaced this norm with a structural sparsity regularizer, such…

Locally Regularized Sparse Graph by Fast Proximal Gradient Descent

2024-09-25 · Dongfang Sun, Yingzhen Yang

Sparse graphs built by sparse representation has been demonstrated to be effective in clustering high-dimensional data. Albeit the compelling empirical performance, the vanilla sparse graph ignores the geometric informat…

Clustering

Accelerated Gradient Methods for Sparse Statistical Learning with Nonconvex Penalties

2020-09-22 · Kai Yang, Masoud Asgharian, Sahir Bhatnagar

Nesterov's accelerated gradient (AG) is a popular technique to optimize objective functions comprising two components: a convex loss and a penalty function. While AG methods perform well for convex penalties, such as the…

DenoisingImage DenoisingSparse LearningVariable Selection

Randomized Subspace Nesterov Accelerated Gradient

2026-05-01 · Gaku Omiya, Pierre-Louis Poirion, Akiko Takeda arxiv

Randomized-subspace methods reduce the cost of first-order optimization by using only low-dimensional projected-gradient information, a feature that is attractive in forward-mode automatic differentiation and communicati…