Fast Low-rank Shared Dictionary Learning for Image Classification
Despite the fact that different objects possess distinct class-specific features, they also usually share common patterns. This observation has been exploited partially in a recently proposed dictionary learning framework by separating the particularity and the commonality (COPAR). Inspired by this, we propose a novel method to explicitly and simultaneously learn a set of common patterns as well as class-specific features for classification with more intuitive constraints. Our dictionary learning framework is hence characterized by both a shared dictionary and particular (class-specific) dictionaries. For the shared dictionary, we enforce a low-rank constraint, i.e. claim that its spanning subspace should have low dimension and the coefficients corresponding to this dictionary should be similar. For the particular dictionaries, we impose on them the well-known constraints stated in the Fisher discrimination dictionary learning (FDDL). Further, we develop new fast and accurate algorithms to solve the subproblems in the learning step, accelerating its convergence. The said algorithms could also be applied to FDDL and its extensions. The efficiencies of these algorithms are theoretically and experimentally verified by comparing their complexities and running time with those of other well-known dictionary learning methods. Experimental results on widely used image datasets establish the advantages of our method over state-of-the-art dictionary learning methods.
Code (2)
Tasks
ClassificationDictionary LearningGeneral Classificationimage-classificationImage ClassificationSimilar Papers 제목 키워드 기반
Learning a low-rank shared dictionary for object classification
Despite the fact that different objects possess distinct class-specific features, they also usually share common patterns. Inspired by this observation, we propose a novel method to explicitly and simultaneously learn a …
ClassificationDictionary LearningGeneral ClassificationObjectClass specific or shared? A cascaded dictionary learning framework for image classification
Dictionary learning methods can be split into: i) class specific dictionary learning ii) class shared dictionary learning. The difference between the two categories is how to use discriminative information. With the firs…
Dictionary LearningGeneral Classificationimage-classificationImage ClassificationShare Your Attention: Transformer Weight Sharing via Matrix-based Dictionary Learning
Large language models have revolutionized AI applications, yet their high computational and memory demands hinder their widespread deployment. Existing compression techniques focus on intra-block optimizations (e.g., low…
Image ClassificationLearning Structured Low-Rank Representations for Image Classification
An approach to learn a structured low-rank representation for image classification is presented. We use a supervised learning method to construct a discriminative and reconstructive dictionary. By introducing an ideal re…
ClassificationGeneral Classificationimage-classificationImage ClassificationDictFormer: Tiny Transformer with Shared Dictionary
We introduce DictFormer with efficient shared dictionary to provide a compact, fast, and accurate transformer model. DictFormer significantly reduces the redundancy in the transformer's parameters by replacing the prior …
Abstractive Text SummarizationLanguage ModelingLanguage ModellingMachine Translation+1