paper-with-me

Papers

Linear Scalarization for Byzantine-robust learning on non-IID data

2022-10-15 · Latifa Errami, El Houcine Bergou

In this work we study the problem of Byzantine-robust learning when data among clients is heterogeneous. We focus on poisoning attacks targeting the convergence of SGD. Although this problem has received great attention; the main Byzantine defenses rely on the IID assumption causing them to fail when data distribution is non-IID even with no attack. We propose the use of Linear Scalarization (LS) as an enhancing method to enable current defenses to circumvent Byzantine attacks in the non-IID setting. The LS method is based on the incorporation of a trade-off vector that penalizes the suspected malicious clients. Empirical analysis corroborates that the proposed LS variants are viable in the IID setting. For mild to strong non-IID data splits, LS is either comparable or outperforming current approaches under state-of-the-art Byzantine attack scenarios.

📄 PDF Abstract BibTeX arXiv:2210.08287

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SGD Stochastic Gradient Descent is an iterative optimization technique that uses minibatches of data to form an expectation of the gradient, rather than the full gradient using…

Similar Papers 제목 키워드 기반

Optimal Scalarizations for Sublinear Hypervolume Regret

2023-07-06 · Qiuyi Zhang

Scalarization is a general, parallizable technique that can be deployed in any multiobjective setting to reduce multiple objectives into one, yet some have dismissed this versatile approach because linear scalarizations …

Bayesian Optimization

AutoScale: Linear Scalarization Guided by Multi-Task Optimization Metrics

2025-08-19 · Yi Yang, Kei Ikemura, Qingwen Zhang, Xiaomeng Zhu 외 arxiv

Recent multi-task learning studies suggest that linear scalarization, when using well-chosen fixed task weights, can achieve comparable to or even better performance than complex multi-task optimization (MTO) methods. It…

Multi-Task Learning

Revisiting Scalarization in Multi-Task Learning: A Theoretical Perspective

2023-08-27 · NeurIPS 2023 11

Linear scalarization, i.e., combining all loss functions by a weighted sum, has been the default choice in the literature of multi-task learning (MTL) since its inception. In recent years, there is a surge of interest in…

Multi-Task Learning

Online Mirror Descent for Tchebycheff Scalarization in Multi-Objective Optimization

2024-10-29 · Meitong Liu, Xiaoyuan Zhang, Chulin Xie, Kate Donahue 외

The goal of multi-objective optimization (MOO) is to learn under multiple, potentially conflicting, objectives. One widely used technique to tackle MOO is through linear scalarization, where one fixed preference vector i…

FairnessFederated Learning

Reconstructing Physics-Informed Machine Learning for Traffic Flow Modeling: a Multi-Gradient Descent and Pareto Learning Approach

2025-05-19 · Yuan-Zheng Lei, Yaobang Gong, Dianwei Chen, Yao Cheng 외

Physics-informed machine learning (PIML) is crucial in modern traffic flow modeling because it combines the benefits of both physics-based and data-driven approaches. In conventional PIML, physical information is typical…

Physics-informed machine learning