paper-with-me

홈 › Papers

TL-PCA: Transfer Learning of Principal Component Analysis

2024-10-14 · Sharon Hendy, Yehuda Dar

Principal component analysis (PCA) can be significantly limited when there is too few examples of the target data of interest. We propose a transfer learning approach to PCA (TL-PCA) where knowledge from a related source task is used in addition to the scarce data of a target task. Our TL-PCA has two versions, one that uses a pretrained PCA solution of the source task, and another that uses the source data. Our proposed approach extends the PCA optimization objective with a penalty on the proximity of the target subspace and the source subspace as given by the pretrained source model or the source data. This optimization is solved by eigendecomposition for which the number of data-dependent eigenvectors (i.e., principal directions of TL-PCA) is not limited to the number of target data examples, which is a root cause that limits the standard PCA performance. Accordingly, our results for image datasets show that the representation of test data is improved by TL-PCA for dimensionality reduction where the learned subspace dimension is lower or higher than the number of target data examples.

📄 PDF Abstract BibTeX arXiv:2410.10805

Code (0)

등록된 구현이 없습니다.

Tasks

Dimensionality ReductionTransfer Learning

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Robust Transfer Principal Component Analysis with Rank Constraints

2013-12-01 · NeurIPS 2013 12 · Yuhong Guo

Principal component analysis (PCA), a well-established technique for data analysis and processing, provides a convenient form of dimensionality reduction that is effective for cleaning small Gaussian noises presented in …

DenoisingDimensionality ReductionImage Denoising

Kernel principal component analysis network for image classification

2015-12-20 · Dan Wu, Jiasong Wu, Rui Zeng, Longyu Jiang 외

In order to classify the nonlinear feature with linear classifier and improve the classification accuracy, a deep learning network named kernel principal component analysis network (KPCANet) is proposed. First, mapping t…

ClassificationFace RecognitionGeneral Classificationimage-classification+2

Principal Component Analysis versus Factor Analysis

2021-10-21 · Zenon Gniazdowski

The article discusses selected problems related to both principal component analysis (PCA) and factor analysis (FA). In particular, both types of analysis were compared. A vector interpretation for both PCA and FA has al…

Transfer learning for predicting source terms of principal component transport in chemically reactive flow

2023-12-01 · Ki Sung Jung, Tarek Echekki, Jacqueline H. Chen, Mohammad Khalil

The objective of this study is to evaluate whether the number of requisite training samples can be reduced with the use of various transfer learning models for predicting, for example, the chemical source terms of the da…

Transfer Learning

Iterated and exponentially weighted moving principal component analysis

2021-08-30 · SSRN 2021 8 · Paul Bilokon, David Finkelstein

The principal component analysis (PCA) is a staple statistical and unsupervised machine learning technique in finance. The application of PCA in a financial setting is associated with several technical difficulties, such…