paper-with-me

홈 › Papers

Block and Group Regularized Sparse Modeling for Dictionary Learning

2013-06-01 · CVPR 2013 6 · Yu-Tseh Chi, Mohsen Ali, Ajit Rajwade, Jeffrey Ho

This paper proposes a dictionary learning framework that combines the proposed block/group (BGSC) or reconstructed block/group (R-BGSC) sparse coding schemes with the novel Intra-block Coherence Suppression Dictionary Learning (ICS-DL) algorithm. An important and distinguishing feature of the proposed framework is that all dictionary blocks are trained simultaneously with respect to each data group while the intra-block coherence being explicitly minimized as an important objective. We provide both empirical evidence and heuristic support for this feature that can be considered as a direct consequence of incorporating both the group structure for the input data and the block structure for the dictionary in the learning process. The optimization problems for both the dictionary learning and sparse coding can be solved efficiently using block-gradient descent, and the details of the optimization algorithms are presented. We evaluate the proposed methods using well-known datasets, and favorable comparisons with state-of-the-art dictionary learning methods demonstrate the viability and validity of the proposed framework.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Dictionary Learning

Similar Papers 제목 키워드 기반

Correlation and Class Based Block Formation for Improved Structured Dictionary Learning

2017-08-04 · Nagendra Kumar, Rohit Sinha

In recent years, the creation of block-structured dictionary has attracted a lot of interest. Learning such dictionaries involve two step process: block formation and dictionary update. Both these steps are important in …

ClusteringDictionary LearningGeneral ClassificationSpeaker Verification

Group-based Sparse Representation for Image Restoration

2014-05-14 · Jian Zhang, Debin Zhao, Wen Gao

Traditional patch-based sparse representation modeling of natural images usually suffer from two problems. First, it has to solve a large-scale optimization problem with high computational complexity in dictionary learni…

Compressive SensingDeblurringDictionary LearningImage Deblurring+2

Frequency Regularized Deep Convolutional Dictionary Learning and Application to Blind Denoising

2021-01-01 · Nikola Pavle Janjusevic, Amirhossein Khalilian-Gourtani, Yao Wang

Sparse representation via a learned dictionary is a powerful prior for natural images. In recent years, unrolled sparse coding algorithms (e.g. LISTA) have proven to be useful for constructing interpretable deep-learning…

DenoisingDictionary LearningImage Restoration

Non-parametric Group Orthogonal Matching Pursuit for Sparse Learning with Multiple Kernels

2011-12-01 · NeurIPS 2011 12 · Vikas Sindhwani, Aurelie C. Lozano

We consider regularized risk minimization in a large dictionary of Reproducing kernel Hilbert Spaces (RKHSs) over which the target function has a sparse representation. This setting, commonly referred to as Sparse Mult…

Generalization BoundsSparse Learning

Subspace-Aware Sparse Autoencoders for Effective Mechanistic Interpretability

2026-06-04 · Seyed Arshan Dalili, Mehrdad Mahdavi arxiv

Sparse Autoencoders (SAEs) are widely used for mechanistic interpretability in large language models, yet their formulation assigns each latent feature a single decoder direction, implicitly assuming features to be one-d…