$\ell_0$ Sparsifying Transform Learning with Efficient Optimal Updates and Convergence Guarantees
Many applications in signal processing benefit from the sparsity of signals in a certain transform domain or dictionary. Synthesis sparsifying dictionaries that are directly adapted to data have been popular in applications such as image denoising, inpainting, and medical image reconstruction. In this work, we focus instead on the sparsifying transform model, and study the learning of well-conditioned square sparsifying transforms. The proposed algorithms alternate between a $\ell_0$ "norm"-based sparse coding step, and a non-convex transform update step. We derive the exact analytical solution for each of these steps. The proposed solution for the transform update step achieves the global minimum in that step, and also provides speedups over iterative solutions involving conjugate gradients. We establish that our alternating algorithms are globally convergent to the set of local minimizers of the non-convex transform learning problems. In practice, the algorithms are insensitive to initialization. We present results illustrating the promising performance and significant speed-ups of transform learning over synthesis K-SVD in image denoising.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingImage DenoisingImage ReconstructionSimilar Papers 제목 키워드 기반
FRIST - Flipping and Rotation Invariant Sparsifying Transform Learning and Applications
Features based on sparse representation, especially using the synthesis dictionary model, have been heavily exploited in signal processing and computer vision. However, synthesis dictionary learning typically involves NP…
compressed sensingDenoisingDictionary LearningImage ReconstructionEfficient Blind Compressed Sensing Using Sparsifying Transforms with Convergence Guarantees and Application to MRI
Natural signals and images are well-known to be approximately sparse in transform domains such as Wavelets and DCT. This property has been heavily exploited in various applications in image processing and medical imaging…
compressed sensingImage ReconstructionVIDOSAT: High-dimensional Sparsifying Transform Learning for Online Video Denoising
Techniques exploiting the sparsity of images in a transform domain have been effective for various applications in image and video processing. Transform learning methods involve cheap computations and have been demonstra…
DenoisingDictionary LearningImage DenoisingImage Reconstruction+2Analysis of Fast Structured Dictionary Learning
Sparsity-based models and techniques have been exploited in many signal processing and imaging applications. Data-driven methods based on dictionary and sparsifying transform learning enable learning rich image features …
Dictionary LearningOperator learningTwo-layer Residual Sparsifying Transform Learning for Image Reconstruction
Signal models based on sparsity, low-rank and other properties have been exploited for image reconstruction from limited and corrupted data in medical imaging and other computational imaging applications. In particular, …
Image ReconstructionVocal Bursts Valence Prediction