paper-with-me

Papers

An online algorithm for contrastive Principal Component Analysis

2022-11-14 · Siavash Golkar, David Lipshutz, Tiberiu Tesileanu, Dmitri B. Chklovskii

Finding informative low-dimensional representations that can be computed efficiently in large datasets is an important problem in data analysis. Recently, contrastive Principal Component Analysis (cPCA) was proposed as a more informative generalization of PCA that takes advantage of contrastive learning. However, the performance of cPCA is sensitive to hyper-parameter choice and there is currently no online algorithm for implementing cPCA. Here, we introduce a modified cPCA method, which we denote cPCA*, that is more interpretable and less sensitive to the choice of hyper-parameter. We derive an online algorithm for cPCA* and show that it maps onto a neural network with local learning rules, so it can potentially be implemented in energy efficient neuromorphic hardware. We evaluate the performance of our online algorithm on real datasets and highlight the differences and similarities with the original formulation.

📄 PDF Abstract BibTeX arXiv:2211.07723

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive Learning

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Near-Optimal Stochastic Approximation for Online Principal Component Estimation

2016-03-16 · Chris Junchi Li, Mengdi Wang, Han Liu, Tong Zhang

Principal component analysis (PCA) has been a prominent tool for high-dimensional data analysis. Online algorithms that estimate the principal component by processing streaming data are of tremendous practical and theore…

Online Robust Principal Component Analysis with Change Point Detection

2017-02-19 · Wei Xiao, Xiaolin Huang, Jorge Silva, Saba Emrani 외

Robust PCA methods are typically batch algorithms which requires loading all observations into memory before processing. This makes them inefficient to process big data. In this paper, we develop an efficient online robu…

Change Point DetectionTwo-sample testing

Contrastive Principal Component Analysis

2017-09-20 · Abubakar Abid, Martin J. Zhang, Vivek K. Bagaria, James Zou

We present a new technique called contrastive principal component analysis (cPCA) that is designed to discover low-dimensional structure that is unique to a dataset, or enriched in one dataset relative to other data. The…

Denoisingfeature selectionSubgroup Discovery

Probabilistic Contrastive Principal Component Analysis

2020-12-14 · Didong Li, Andrew Jones, Barbara Engelhardt

Dimension reduction is useful for exploratory data analysis. In many applications, it is of interest to discover variation that is enriched in a "foreground" dataset relative to a "background" dataset. Recently, contrast…

Dimensionality ReductionUncertainty Quantification

Online Adaptive Principal Component Analysis and Its extensions

2019-01-23 · Jianjun Yuan, Andrew Lamperski

We propose algorithms for online principal component analysis (PCA) and variance minimization for adaptive settings. Previous literature has focused on upper bounding the static adversarial regret, whose comparator is th…