paper-with-me

Papers

Robust Kronecker Component Analysis

2018-01-18 · Mehdi Bahri, Yannis Panagakis, Stefanos Zafeiriou

Dictionary learning and component analysis models are fundamental for learning compact representations that are relevant to a given task (feature extraction, dimensionality reduction, denoising, etc.). The model complexity is encoded by means of specific structure, such as sparsity, low-rankness, or nonnegativity. Unfortunately, approaches like K-SVD - that learn dictionaries for sparse coding via Singular Value Decomposition (SVD) - are hard to scale to high-volume and high-dimensional visual data, and fragile in the presence of outliers. Conversely, robust component analysis methods such as the Robust Principal Component Analysis (RPCA) are able to recover low-complexity (e.g., low-rank) representations from data corrupted with noise of unknown magnitude and support, but do not provide a dictionary that respects the structure of the data (e.g., images), and also involve expensive computations. In this paper, we propose a novel Kronecker-decomposable component analysis model, coined as Robust Kronecker Component Analysis (RKCA), that combines ideas from sparse dictionary learning and robust component analysis. RKCA has several appealing properties, including robustness to gross corruption; it can be used for low-rank modeling, and leverages separability to solve significantly smaller problems. We design an efficient learning algorithm by drawing links with a restricted form of tensor factorization, and analyze its optimality and low-rankness properties. The effectiveness of the proposed approach is demonstrated on real-world applications, namely background subtraction and image denoising and completion, by performing a thorough comparison with the current state of the art.

📄 PDF Abstract BibTeX arXiv:1801.06432

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingDictionary LearningDimensionality ReductionImage Denoising

Similar Papers 제목 키워드 기반

Diving into Kronecker Adapters: Component Design Matters

2026-02-01 · Jiayu Bai, Danchen Yu, Zhenyu Liao, TianQi Hou 외 arxiv

Kronecker adapters have emerged as a promising approach for fine-tuning large-scale models, enabling high-rank updates through tunable component structures. However, existing work largely treats the component structure a…

Multilinear Common Component Analysis via Kronecker Product Representation

2020-09-06 · Kohei Yoshikawa, Shuichi. Kawano

We consider the problem of extracting a common structure from multiple tensor datasets. For this purpose, we propose multilinear common component analysis (MCCA) based on Kronecker products of mode-wise covariance matric…

Sketching for Kronecker Product Regression and P-splines

2017-12-27 · Huaian Diao, Zhao Song, Wen Sun, David P. Woodruff

TensorSketch is an oblivious linear sketch introduced in Pagh'13 and later used in Pham, Pagh'13 in the context of SVMs for polynomial kernels. It was shown in Avron, Nguyen, Woodruff'14 that TensorSketch provides a subs…

regression

Robust Kronecker-Decomposable Component Analysis for Low-Rank Modeling

2017-03-22 · ICCV 2017 10 · Mehdi Bahri, Yannis Panagakis, Stefanos Zafeiriou

Dictionary learning and component analysis are part of one of the most well-studied and active research fields, at the intersection of signal and image processing, computer vision, and statistical machine learning. In di…

DenoisingDictionary LearningImage Denoising

Hybrid Kronecker Product Decomposition and Approximation

2019-12-06 · Chencheng Cai, Rong Chen, Han Xiao

Discovering the underlying low dimensional structure of high dimensional data has attracted a significant amount of researches recently and has shown to have a wide range of applications. As an effective dimension reduct…

Dimensionality Reduction