paper-with-me

Papers

Online Dictionary Learning for Approximate Archetypal Analysis

2018-09-01 · ECCV 2018 9 · Jieru Mei, Chunyu Wang, Wen-Jun Zeng

Archetypal analysis is an unsupervised learning approach which represents data by convex combinations of a set of archetypes. The archetypes generally correspond to the extremal points in the dataset and are learned by requiring them to be convex combinations of the training data. In spite of its nice property of interpretability, the method is slow. We propose a variant of archetypal analysis which scales gracefully to large datasets. The core idea is to decouple the binding between data and archetypes and require them to be unit normalized. Geometrically, the method learns a convex hull inside the unit sphere and represents the data by their projections on the closest surfaces of the convex hull. By minimizing the representation error, the method pushes the convex hull surfaces close to the regions of the sphere where the data reside. The vertices of the convex hull are the learned archetypes. We apply the method to human faces and poses to validate its effectiveness in the context of reconstructions and classifications.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Dictionary Learning

Methods 이 논문이 사용한 방법론

Affine Coupling 설명 없음
Normalizing Flows Normalizing Flows are a method for constructing complex distributions by transforming a probability density through a series of invertible mappings. By repeatedly applying…

Similar Papers 제목 키워드 기반

Unsupervised Learning of Artistic Styles with Archetypal Style Analysis

2018-05-28 · NeurIPS 2018 12 · Daan Wynen, Cordelia Schmid, Julien Mairal

In this paper, we introduce an unsupervised learning approach to automatically discover, summarize, and manipulate artistic styles from large collections of paintings. Our method is based on archetypal analysis, which is…

Ablating Archetypes: The Stability of Archetypal SAEs is an Artifact of Initialization and Metric Design

2026-06-01 · Michał Brzozowski, Neo Christopher Chung arxiv

Dictionary learning with sparse autoencoders (SAEs) produces overcomplete bases from neural network activations that are often interpretable and reduces polysemanticity. However, features from SAEs vary substantially acr…

Archetypal SAE: Adaptive and Stable Dictionary Learning for Concept Extraction in Large Vision Models

2025-02-18 · Thomas Fel, Ekdeep Singh Lubana, Jacob S. Prince, Matthew Kowal 외

Sparse Autoencoders (SAEs) have emerged as a powerful framework for machine learning interpretability, enabling the unsupervised decomposition of model representations into a dictionary of abstract, human-interpretable c…

Dictionary Learning

Probabilistic methods for approximate archetypal analysis

2021-08-12 · Ruijian Han, Braxton Osting, Dong Wang, Yiming Xu

Archetypal analysis is an unsupervised learning method for exploratory data analysis. One major challenge that limits the applicability of archetypal analysis in practice is the inherent computational complexity of the e…

Archetypal Analysis++: Rethinking the Initialization Strategy

2023-01-31 · Sebastian Mair, Jens Sjölund

Archetypal analysis is a matrix factorization method with convexity constraints. Due to local minima, a good initialization is essential, but frequently used initialization methods yield either sub-optimal starting point…