paper-with-me

Papers

Vertical Federated Principal Component Analysis and Its Kernel Extension on Feature-wise Distributed Data

2022-03-03 · Yiu-ming Cheung, Juyong Jiang, Feng Yu, Jian Lou

Despite enormous research interest and rapid application of federated learning (FL) to various areas, existing studies mostly focus on supervised federated learning under the horizontally partitioned local dataset setting. This paper will study the unsupervised FL under the vertically partitioned dataset setting. Accordingly, we propose the federated principal component analysis for vertically partitioned dataset (VFedPCA) method, which reduces the dimensionality across the joint datasets over all the clients and extracts the principal component feature information for downstream data analysis. We further take advantage of the nonlinear dimensionality reduction and propose the vertical federated advanced kernel principal component analysis (VFedAKPCA) method, which can effectively and collaboratively model the nonlinear nature existing in many real datasets. In addition, we study two communication topologies. The first is a server-client topology where a semi-trusted server coordinates the federated training, while the second is the fully-decentralized topology which further eliminates the requirement of the server by allowing clients themselves to communicate with their neighbors. Extensive experiments conducted on five types of real-world datasets corroborate the efficacy of VFedPCA and VFedAKPCA under the vertically partitioned FL setting. Code is available at: https://github.com/juyongjiang/VFedPCA-VFedAKPCA

📄 PDF Abstract BibTeX arXiv:2203.01752

Code (1)

juyongjiang/vfedpca-vfedakpca 공식 구현

Tasks

Dimensionality ReductionFederated Learning

Similar Papers 제목 키워드 기반

Kernel principal component analysis network for image classification

2015-12-20 · Dan Wu, Jiasong Wu, Rui Zeng, Longyu Jiang 외

In order to classify the nonlinear feature with linear classifier and improve the classification accuracy, a deep learning network named kernel principal component analysis network (KPCANet) is proposed. First, mapping t…

ClassificationFace RecognitionGeneral Classificationimage-classification+2

A Dual Formulation for Probabilistic Principal Component Analysis

2023-07-19 · Henri De Plaen, Johan A. K. Suykens

In this paper, we characterize Probabilistic Principal Component Analysis in Hilbert spaces and demonstrate how the optimal solution admits a representation in dual space. This allows us to develop a generative framework…

Federated Doubly Stochastic Kernel Learning for Vertically Partitioned Data

2020-08-14 · Bin Gu, Zhiyuan Dang, Xiang Li, Heng Huang

In a lot of real-world data mining and machine learning applications, data are provided by multiple providers and each maintains private records of different feature sets about common entities. It is challenging to train…

BIG-bench Machine LearningFederated Learning

Federated Multilinear Principal Component Analysis with Applications in Prognostics

2023-12-11 · Chengyu Zhou, Yuqi Su, Tangbin Xia, Xiaolei Fang

Multilinear Principal Component Analysis (MPCA) is a widely utilized method for the dimension reduction of tensor data. However, the integration of MPCA into federated learning remains unexplored in existing research. To…

Dimensionality ReductionFederated Learning

Deep Kernel Principal Component Analysis for Multi-level Feature Learning

2023-02-22 · Francesco Tonin, Qinghua Tao, Panagiotis Patrinos, Johan A. K. Suykens

Principal Component Analysis (PCA) and its nonlinear extension Kernel PCA (KPCA) are widely used across science and industry for data analysis and dimensionality reduction. Modern deep learning tools have achieved great …

Dimensionality Reduction