paper-with-me

Papers

Distributed Optimal Margin Distribution Machine

2021-09-29 · Yilin Wang, Nan Cao, Teng Zhang, Hai Jin

Optimal margin Distribution Machine (ODM), a newly proposed statistical learning framework rooting in the novel margin theory, demonstrates better generalization performance than the traditional large margin based counterparts. Nonetheless, the same with other kernel methods, it suffers from the ubiquitous scalability problem in terms of both computation time and memory. In this paper, we propose a Distributed solver for ODM (DiODM), which leads to nearly ten times speedup for training kernel ODM. It exploits a novel data partition method to make the local ODM trained on each partition has a solution close to the global one. When linear kernel used, we extend a communication efficient distributed SVRG method to further accelerate the training. Extensive empirical studies validate the superiority of our proposed method compared to other off-the-shelf distributed quadratic programming solvers for kernel methods.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

An Optimal Transport Approach to Personalized Federated Learning

2022-06-06 · Farzan Farnia, Amirhossein Reisizadeh, Ramtin Pedarsani, Ali Jadbabaie

Federated learning is a distributed machine learning paradigm, which aims to train a model using the local data of many distributed clients. A key challenge in federated learning is that the data samples across the clien…

Federated LearningPersonalized Federated Learning

Optimal Margin Distribution Machine

2016-04-12 · Teng Zhang, Zhi-Hua Zhou

Support vector machine (SVM) has been one of the most popular learning algorithms, with the central idea of maximizing the minimum margin, i.e., the smallest distance from the instances to the classification boundary. Re…

Multi-Class Optimal Margin Distribution Machine

2017-08-01 · ICML 2017 8 · Teng Zhang, Zhi-Hua Zhou

Recent studies disclose that maximizing the minimum margin like support vector machines does not necessarily lead to better generalization performances, and instead, it is crucial to optimize the margin distribution…

Binary ClassificationClassificationGeneral ClassificationMulti-class Classification

Optimal margin Distribution Network

2019-05-01 · ICLR 2019 5 · Shen-Huan Lv, Lu Wang, Zhi-Hua Zhou

Recent research about margin theory has proved that maximizing the minimum margin like support vector machines does not necessarily lead to better performance, and instead, it is crucial to optimize the margin distributi…

Near-Optimal Resilient Aggregation Rules for Distributed Learning Using 1-Center and 1-Mean Clustering with Outliers

2023-12-20 · Yuhao Yi, Ronghui You, Hong Liu, Changxin Liu 외

Byzantine machine learning has garnered considerable attention in light of the unpredictable faults that can occur in large-scale distributed learning systems. The key to secure resilience against Byzantine machines in d…

Clusteringimage-classificationImage Classification