paper-with-me

Papers

Robust Kronecker-Decomposable Component Analysis for Low-Rank Modeling

2017-03-22 · ICCV 2017 10 · Mehdi Bahri, Yannis Panagakis, Stefanos Zafeiriou

Dictionary learning and component analysis are part of one of the most well-studied and active research fields, at the intersection of signal and image processing, computer vision, and statistical machine learning. In dictionary learning, the current methods of choice are arguably K-SVD and its variants, which learn a dictionary (i.e., a decomposition) for sparse coding via Singular Value Decomposition. In robust component analysis, leading methods derive from Principal Component Pursuit (PCP), which recovers a low-rank matrix from sparse corruptions of unknown magnitude and support. However, K-SVD is sensitive to the presence of noise and outliers in the training set. Additionally, PCP does not provide a dictionary that respects the structure of the data (e.g., images), and requires expensive SVD computations when solved by convex relaxation. In this paper, we introduce a new robust decomposition of images by combining ideas from sparse dictionary learning and PCP. We propose a novel Kronecker-decomposable component analysis which is robust to gross corruption, can be used for low-rank modeling, and leverages separability to solve significantly smaller problems. We design an efficient learning algorithm by drawing links with a restricted form of tensor factorization. The effectiveness of the proposed approach is demonstrated on real-world applications, namely background subtraction and image denoising, by performing a thorough comparison with the current state of the art.

📄 PDF Abstract BibTeX arXiv:1703.07886

Code (1)

mbahri/KDRSDL 공식 구현

Tasks

DenoisingDictionary LearningImage Denoising

Similar Papers 제목 키워드 기반

Robust Kronecker Component Analysis

2018-01-18 · Mehdi Bahri, Yannis Panagakis, Stefanos Zafeiriou

Dictionary learning and component analysis models are fundamental for learning compact representations that are relevant to a given task (feature extraction, dimensionality reduction, denoising, etc.). The model complexi…

DenoisingDictionary LearningDimensionality ReductionImage Denoising

Diving into Kronecker Adapters: Component Design Matters

2026-02-01 · Jiayu Bai, Danchen Yu, Zhenyu Liao, TianQi Hou 외 arxiv

Kronecker adapters have emerged as a promising approach for fine-tuning large-scale models, enabling high-rank updates through tunable component structures. However, existing work largely treats the component structure a…

Sketching for Kronecker Product Regression and P-splines

2017-12-27 · Huaian Diao, Zhao Song, Wen Sun, David P. Woodruff

TensorSketch is an oblivious linear sketch introduced in Pagh'13 and later used in Pham, Pagh'13 in the context of SVMs for polynomial kernels. It was shown in Avron, Nguyen, Woodruff'14 that TensorSketch provides a subs…

regression

MoKA: Mixture of Kronecker Adapters

2025-08-05 · Mohammadreza Sadeghi, Mahsa Ghazvini Nejad, MirHamed Jafarzadeh Asl, Yu Gu 외 arxiv

Parameter-efficient fine-tuning (PEFT) is essential for reducing the computational overhead of large language models (LLMs). Low-rank family adapters are commonly used to control the parameter size efficiently while main…

parameter-efficient fine-tuning

Hybrid Kronecker Product Decomposition and Approximation

2019-12-06 · Chencheng Cai, Rong Chen, Han Xiao

Discovering the underlying low dimensional structure of high dimensional data has attracted a significant amount of researches recently and has shown to have a wide range of applications. As an effective dimension reduct…

Dimensionality Reduction