paper-with-me

Papers

Fair Streaming Principal Component Analysis: Statistical and Algorithmic Viewpoint

2023-10-28 · NeurIPS 2023 11 · Junghyun Lee, Hanseul Cho, Se-Young Yun, Chulhee Yun

Fair Principal Component Analysis (PCA) is a problem setting where we aim to perform PCA while making the resulting representation fair in that the projected distributions, conditional on the sensitive attributes, match one another. However, existing approaches to fair PCA have two main problems: theoretically, there has been no statistical foundation of fair PCA in terms of learnability; practically, limited memory prevents us from using existing approaches, as they explicitly rely on full access to the entire data. On the theoretical side, we rigorously formulate fair PCA using a new notion called \emph{probably approximately fair and optimal} (PAFO) learnability. On the practical side, motivated by recent advances in streaming algorithms for addressing memory limitation, we propose a new setting called \emph{fair streaming PCA} along with a memory-efficient algorithm, fair noisy power method (FNPM). We then provide its {\it statistical} guarantee in terms of PAFO-learnability, which is the first of its kind in fair PCA literature. Lastly, we verify the efficacy and memory efficiency of our algorithm on real-world datasets.

📄 PDF Abstract BibTeX arXiv:2310.18593

Code (1)

hanseuljo/fair-streaming-pca 공식 구현 jax

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Streaming Kernel PCA with \tilde{O}(\sqrt{n}) Random Features

2018-12-01 · NeurIPS 2018 12 · Md Enayat Ullah, Poorya Mianjy, Teodor Vanislavov Marinov, Raman Arora

We study the statistical and computational aspects of kernel principal component analysis using random Fourier features and show that under mild assumptions, $O(\sqrt{n} \log n)$ features suffices to achieve $O(1/\epsilo…

Streaming Kernel PCA with $\tilde{O}(\sqrt{n})$ Random Features

2018-08-02 · Enayat Ullah, Poorya Mianjy, Teodor V. Marinov, Raman Arora

We study the statistical and computational aspects of kernel principal component analysis using random Fourier features and show that under mild assumptions, $O(\sqrt{n} \log n)$ features suffices to achieve $O(1/\epsilo…

Streaming Principal Component Analysis in Noisy Setting

2018-07-01 · ICML 2018 7 · Teodor Vanislavov Marinov, Poorya Mianjy, Raman Arora

We study streaming algorithms for principal component analysis (PCA) in noisy settings. We present computationally efficient algorithms with sub-linear regret bounds for PCA in the presence of noise, missing data, a…

Memory-efficient training with streaming dimensionality reduction

2020-04-25 · Siyuan Huang, Brian D. Hoskins, Matthew W. Daniels, Mark D. Stiles 외

The movement of large quantities of data during the training of a Deep Neural Network presents immense challenges for machine learning workloads. To minimize this overhead, especially on the movement and calculation of g…

BIG-bench Machine LearningDimensionality Reduction

Sequential Logistic Principal Component Analysis (SLPCA): Dimensional Reduction in Streaming Multivariate Binary-State System

2014-07-16 · Zhaoyi Kang, Costas J. Spanos

Sequential or online dimensional reduction is of interests due to the explosion of streaming data based applications and the requirement of adaptive statistical modeling, in many emerging fields, such as the modeling of …