MrTF: Model Refinery for Transductive Federated Learning

2023-05-07 · Xin-Chun Li, Yang Yang, De-Chuan Zhan

We consider a real-world scenario in which a newly-established pilot project needs to make inferences for newly-collected data with the help of other parties under privacy protection policies. Current federated learning (FL) paradigms are devoted to solving the data heterogeneity problem without considering the to-be-inferred data. We propose a novel learning paradigm named transductive federated learning (TFL) to simultaneously consider the structural information of the to-be-inferred data. On the one hand, the server could use the pre-available test samples to refine the aggregated models for robust model fusion, which tackles the data heterogeneity problem in FL. On the other hand, the refinery process incorporates test samples into training and could generate better predictions in a transductive manner. We propose several techniques including stabilized teachers, rectified distillation, and clustered label refinery to facilitate the model refinery process. Abundant experimental studies verify the superiorities of the proposed \underline{M}odel \underline{r}efinery framework for \underline{T}ransductive \underline{F}ederated learning (MrTF). The source code is available at \url{https://github.com/lxcnju/MrTF}.

📄 PDF Abstract BibTeX arXiv:2305.04201

Code (1)

lxcnju/mrtf 공식 구현 pytorch

Tasks

Federated Learningmodel

Methods 이 논문이 사용한 방법론

Test 설명 없음

DDOR: Delta Debugging for Explainable Overrefusal Testing and Repair

2026-06-02 · Qinyan Zhou, Peixin Zhang, Jun Sun, Haonan Zhang 외 arxiv

While safety alignment and guardrails help large language models (LLMs) avoid harmful outputs, they can also induce overrefusal, i.e., unwarranted rejection of benign queries that merely appear risky. We present DDOR (De…

When Computing Power Network Meets Distributed Machine Learning: An Efficient Federated Split Learning Framework

2023-05-22 · Xinjing Yuan, Lingjun Pu, Lei Jiao, Xiaofei Wang 외

In this paper, we advocate CPN-FedSL, a novel and flexible Federated Split Learning (FedSL) framework over Computing Power Network (CPN). We build a dedicated model to capture the basic settings and learning characterist…

Scheduling

Cross-client Label Propagation for Transductive and Semi-Supervised Federated Learning

2022-10-12 · Jonathan Scott, Michelle Yeo, Christoph H. Lampert

We present Cross-Client Label Propagation(XCLP), a new method for transductive federated learning. XCLP estimates a data graph jointly from the data of multiple clients and computes labels for the unlabeled data by propa…

Federated Learning Pseudo Label

Reinforcement Learning-Driven Plant-Wide Refinery Planning Using Model Decomposition

2025-04-11 · Zhouchang Li, Runze Lin, Hongye Su, Lei Xie

In the era of smart manufacturing and Industry 4.0, the refining industry is evolving towards large-scale integration and flexible production systems. In response to these new demands, this paper presents a novel optimiz…

Computational Efficiency Deep Reinforcement Learning reinforcement-learning Reinforcement Learning

Label Refinery: Improving ImageNet Classification through Label Progression

2018-05-07 · Hessam Bagherinezhad, Maxwell Horton, Mohammad Rastegari, Ali Farhadi

Among the three main components (data, labels, and models) of any supervised learning system, data and models have been the main subjects of active research. However, studying labels and their properties has received ver…

Classification General Classification