paper-with-me

Papers

Fast Low-rank Shared Dictionary Learning for Image Classification

2016-10-27 · Tiep Vu, Vishal Monga

Despite the fact that different objects possess distinct class-specific features, they also usually share common patterns. This observation has been exploited partially in a recently proposed dictionary learning framework by separating the particularity and the commonality (COPAR). Inspired by this, we propose a novel method to explicitly and simultaneously learn a set of common patterns as well as class-specific features for classification with more intuitive constraints. Our dictionary learning framework is hence characterized by both a shared dictionary and particular (class-specific) dictionaries. For the shared dictionary, we enforce a low-rank constraint, i.e. claim that its spanning subspace should have low dimension and the coefficients corresponding to this dictionary should be similar. For the particular dictionaries, we impose on them the well-known constraints stated in the Fisher discrimination dictionary learning (FDDL). Further, we develop new fast and accurate algorithms to solve the subproblems in the learning step, accelerating its convergence. The said algorithms could also be applied to FDDL and its extensions. The efficiencies of these algorithms are theoretically and experimentally verified by comparing their complexities and running time with those of other well-known dictionary learning methods. Experimental results on widely used image datasets establish the advantages of our method over state-of-the-art dictionary learning methods.

📄 PDF Abstract BibTeX arXiv:1610.08606

Code (2)

tiepvupsu/DICTOL
tiepvupsu/DICTOL_python

Tasks

ClassificationDictionary LearningGeneral Classificationimage-classificationImage Classification

Similar Papers 제목 키워드 기반

Learning a low-rank shared dictionary for object classification

2016-01-31 · Tiep H. Vu, Vishal Monga

Despite the fact that different objects possess distinct class-specific features, they also usually share common patterns. Inspired by this observation, we propose a novel method to explicitly and simultaneously learn a …

ClassificationDictionary LearningGeneral ClassificationObject

Class specific or shared? A cascaded dictionary learning framework for image classification

2019-04-17 · Yan-Jiang Wang, Shuai Shao, Rui Xu, Werifeng Liu 외

Dictionary learning methods can be split into: i) class specific dictionary learning ii) class shared dictionary learning. The difference between the two categories is how to use discriminative information. With the firs…

Dictionary LearningGeneral Classificationimage-classificationImage Classification

Share Your Attention: Transformer Weight Sharing via Matrix-based Dictionary Learning

2025-08-06 · Magauiya Zhussip, Dmitriy Shopkhoev, Ammar Ali, Stamatios Lefkimmiatis arxiv

Large language models have revolutionized AI applications, yet their high computational and memory demands hinder their widespread deployment. Existing compression techniques focus on intra-block optimizations (e.g., low…

Image Classification

Learning Structured Low-Rank Representations for Image Classification

2013-06-01 · CVPR 2013 6 · Yangmuzi Zhang, Zhuolin Jiang, Larry S. Davis

An approach to learn a structured low-rank representation for image classification is presented. We use a supervised learning method to construct a discriminative and reconstructive dictionary. By introducing an ideal re…

ClassificationGeneral Classificationimage-classificationImage Classification

DictFormer: Tiny Transformer with Shared Dictionary

2021-09-29 · ICLR 2022 4 · Qian Lou, Ting Hua, Yen-Chang Hsu, Yilin Shen 외

We introduce DictFormer with efficient shared dictionary to provide a compact, fast, and accurate transformer model. DictFormer significantly reduces the redundancy in the transformer's parameters by replacing the prior …

Abstractive Text SummarizationLanguage ModelingLanguage ModellingMachine Translation+1