Adaptive Iterative Soft-Thresholding Algorithm with the Median Absolute Deviation
The adaptive Iterative Soft-Thresholding Algorithm (ISTA) has been a popular algorithm for finding a desirable solution to the LASSO problem without explicitly tuning the regularization parameter $λ$. Despite that the adaptive ISTA is a successful practical algorithm, few theoretical results exist. In this paper, we present the theoretical analysis on the adaptive ISTA with the thresholding strategy of estimating noise level by median absolute deviation. We show properties of the fixed points of the algorithm, including scale equivariance, non-uniqueness, and local stability, prove the local linear convergence guarantee, and show its global convergence behavior.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
RDFNet: Regional Dynamic FISTA-Net for Spectral Snapshot Compressive Imaging
Deep convolutional neural networks have recently shown promising results in compressive spectral reconstruction. Previous methods, however, usually adopt a single mapping function for sparse representation. Considering t…
Spectral ReconstructionBetween hard and soft thresholding: optimal iterative thresholding algorithms
Iterative thresholding algorithms seek to optimize a differentiable objective function over a sparsity or rank constraint by alternating between gradient steps that reduce the objective, and thresholding steps that enfor…
Understanding the Learned Iterative Soft Thresholding Algorithm with matrix factorization
Sparse coding is a core building block in many data analysis and machine learning pipelines. Typically it is solved by relying on generic optimization techniques, such as the Iterative Soft Thresholding Algorithm and its…
A Nonlinear Weighted Total Variation Image Reconstruction Algorithm for Electrical Capacitance Tomography
A new iterative image reconstruction algorithm for electrical capacitance tomography (ECT) is proposed that is based on iterative soft thresholding of a total variation penalty and adaptive reweighted compressive sensing…
Compressive SensingImage ReconstructionSensitivityRecovery of Sparse and Low Rank Components of Matrices Using Iterative Method with Adaptive Thresholding
In this letter, we propose an algorithm for recovery of sparse and low rank components of matrices using an iterative method with adaptive thresholding. In each iteration, the low rank and sparse components are obtained …