paper-with-me

Papers

FedPDD: A Privacy-preserving Double Distillation Framework for Cross-silo Federated Recommendation

2023-05-09 · Sheng Wan, Dashan Gao, Hanlin Gu, Daning Hu

Cross-platform recommendation aims to improve recommendation accuracy by gathering heterogeneous features from different platforms. However, such cross-silo collaborations between platforms are restricted by increasingly stringent privacy protection regulations, thus data cannot be aggregated for training. Federated learning (FL) is a practical solution to deal with the data silo problem in recommendation scenarios. Existing cross-silo FL methods transmit model information to collaboratively build a global model by leveraging the data of overlapped users. However, in reality, the number of overlapped users is often very small, thus largely limiting the performance of such approaches. Moreover, transmitting model information during training requires high communication costs and may cause serious privacy leakage. In this paper, we propose a novel privacy-preserving double distillation framework named FedPDD for cross-silo federated recommendation, which efficiently transfers knowledge when overlapped users are limited. Specifically, our double distillation strategy enables local models to learn not only explicit knowledge from the other party but also implicit knowledge from its past predictions. Moreover, to ensure privacy and high efficiency, we employ an offline training scheme to reduce communication needs and privacy leakage risk. In addition, we adopt differential privacy to further protect the transmitted information. The experiments on two real-world recommendation datasets, HetRec-MovieLens and Criteo, demonstrate the effectiveness of FedPDD compared to the state-of-the-art approaches.

📄 PDF Abstract BibTeX arXiv:2305.06272

Code (0)

등록된 구현이 없습니다.

Tasks

Federated LearningPrivacy Preserving

Similar Papers 제목 키워드 기반

Preserving Privacy in Federated Learning with Ensemble Cross-Domain Knowledge Distillation

2022-09-10 · Xuan Gong, Abhishek Sharma, Srikrishna Karanam, Ziyan Wu 외

Federated Learning (FL) is a machine learning paradigm where local nodes collaboratively train a central model while the training data remains decentralized. Existing FL methods typically share model parameters or employ…

Federated Learningimage-classificationImage ClassificationKnowledge Distillation+3

A Framework for Double-Blind Federated Adaptation of Foundation Models

2025-02-03 · Nurbek Tastan, Karthik Nandakumar

The availability of foundational models (FMs) pre-trained on large-scale data has advanced the state-of-the-art in many computer vision tasks. While FMs have demonstrated good zero-shot performance on many image classifi…

Federated Learningimage-classificationImage ClassificationKnowledge Distillation+2

Federated Learning with Privacy-Preserving Ensemble Attention Distillation

2022-10-16 · Xuan Gong, Liangchen Song, Rishi Vedula, Abhishek Sharma 외

Federated Learning (FL) is a machine learning paradigm where many local nodes collaboratively train a central model while keeping the training data decentralized. This is particularly relevant for clinical applications s…

Federated Learningimage-classificationImage ClassificationKnowledge Distillation+1

Secure Federated Data Distillation

2025-02-19 · Marco Arazzi, Mert Cihangiroglu, Serena Nicolazzo, Antonino Nocera

Dataset Distillation (DD) is a powerful technique for reducing large datasets into compact, representative synthetic datasets, accelerating Machine Learning training. However, traditional DD methods operate in a centrali…

Dataset DistillationPrivacy Preserving

PDSS: A Privacy-Preserving Framework for Step-by-Step Distillation of Large Language Models

2024-06-18 · Tao Fan, Yan Kang, Weijing Chen, Hanlin Gu 외

In the context of real-world applications, leveraging large language models (LLMs) for domain-specific tasks often faces two major challenges: domain-specific knowledge privacy and constrained resources. To address these…

DecoderLanguage ModelingLanguage ModellingMulti-Task Learning+3