paper-with-me

홈 › Papers

Sparse NMF with Archetypal Regularization: Computational and Robustness Properties

2021-04-08 · Kayhan Behdin, Rahul Mazumder

We consider the problem of sparse nonnegative matrix factorization (NMF) using archetypal regularization. The goal is to represent a collection of data points as nonnegative linear combinations of a few nonnegative sparse factors with appealing geometric properties, arising from the use of archetypal regularization. We generalize the notion of robustness studied in Javadi and Montanari (2019) (without sparsity) to the notions of (a) strong robustness that implies each estimated archetype is close to the underlying archetypes and (b) weak robustness that implies there exists at least one recovered archetype that is close to the underlying archetypes. Our theoretical results on robustness guarantees hold under minimal assumptions on the underlying data, and applies to settings where the underlying archetypes need not be sparse. We present theoretical results and illustrative examples to strengthen the insights underlying the notions of robustness. We propose new algorithms for our optimization problem; and present numerical experiments on synthetic and real data sets that shed further insights into our proposed framework and theoretical developments.

📄 PDF Abstract BibTeX arXiv:2104.03527

Code (1)

kayhanbehdin/SparseAA 공식 구현

Similar Papers 제목 키워드 기반

A Geometric Approach to Archetypal Analysis via Sparse Projections

2020-01-01 · ICML 2020 1 · Vinayak Abrol, Pulkit Sharma

Archetypal analysis (AA) aims to extract patterns using self-expressive decomposition of data as convex combinations of extremal points (on the convex hull) of the data. This work presents a computationally efficient gre…

Data Visualization

Unsupervised Learning of Artistic Styles with Archetypal Style Analysis

2018-05-28 · NeurIPS 2018 12 · Daan Wynen, Cordelia Schmid, Julien Mairal

In this paper, we introduce an unsupervised learning approach to automatically discover, summarize, and manipulate artistic styles from large collections of paintings. Our method is based on archetypal analysis, which is…

Wasserstein Archetypal Analysis

2022-10-25 · Katy Craig, Braxton Osting, Dong Wang, Yiming Xu

Archetypal analysis is an unsupervised machine learning method that summarizes data using a convex polytope. In its original formulation, for fixed k, the method finds a convex polytope with k vertices, called archetype …

Incorporating Fairness Constraints into Archetypal Analysis

2025-07-16 · Aleix Alcacer, Irene Epifanio arxiv

Archetypal Analysis (AA) is an unsupervised learning method that represents data as convex combinations of extreme patterns called archetypes. While AA provides interpretable and low-dimensional representations, it can i…

Representation Learning

Fast and Robust Archetypal Analysis for Representation Learning

2014-05-26 · CVPR 2014 6 · Yuansi Chen, Julien Mairal, Zaid Harchaoui

We revisit a pioneer unsupervised learning technique called archetypal analysis, which is related to successful data analysis methods such as sparse coding and non-negative matrix factorization. Since it was proposed, ar…

General ClassificationRepresentation Learning