Communication-efficient distributed eigenspace estimation with arbitrary node failures
We develop an eigenspace estimation algorithm for distributed environments with arbitrary node failures, where a subset of computing nodes can return structurally valid but otherwise arbitrarily chosen responses. Notably, this setting encompasses several important scenarios that arise in distributed computing and data-collection environments such as silent/soft errors, outliers or corrupted data at certain nodes, and adversarial responses. Our estimator builds upon and matches the performance of a recently proposed non-robust estimator up to an additive $\tilde{O}(\sigma \sqrt{\alpha})$ error, where $\sigma^2$ is the variance of the existing estimator and $\alpha$ is the fraction of corrupted nodes.
Code (0)
등록된 구현이 없습니다.
Tasks
Distributed ComputingvalidSimilar Papers 제목 키워드 기반
Distributed Estimation for Principal Component Analysis: an Enlarged Eigenspace Analysis
The growing size of modern data sets brings many challenges to the existing statistical estimation approaches, which calls for new distributed methodologies. This paper studies distributed estimation for a fundamental st…
Online Distributed Estimation of Principal Eigenspaces
Principal components analysis (PCA) is a widely used dimension reduction technique with an extensive range of applications. In this paper, an online distributed algorithm is proposed for recovering the principal eigenspa…
ClusteringDimensionality ReductionCommunication-efficient distributed eigenspace estimation
Distributed computing is a standard way to scale up machine learning and data science algorithms to process large amounts of data. In such settings, avoiding communication amongst machines is paramount for achieving high…
Distributed ComputingFedPower: Privacy-Preserving Distributed Eigenspace Estimation
Eigenspace estimation is fundamental in machine learning and statistics, which has found applications in PCA, dimension reduction, and clustering, among others. The modern machine learning community usually assumes that …
BIG-bench Machine LearningDimensionality ReductionFederated LearningPrivacy PreservingLow-Communication Resilient Distributed Estimation Algorithm Based on Memory Mechanism
In multi-task adversarial networks, the accurate estimation of unknown parameters in a distributed algorithm is hindered by attacked nodes or links. To tackle this challenge, this brief proposes a low-communication resil…