paper-with-me

홈 › Papers

Federated Active Learning for Target Domain Generalisation

2023-12-04 · Razvan Caramalau, Binod Bhattarai, Danail Stoyanov

In this paper, we introduce Active Learning framework in Federated Learning for Target Domain Generalisation, harnessing the strength from both learning paradigms. Our framework, FEDALV, composed of Active Learning (AL) and Federated Domain Generalisation (FDG), enables generalisation of an image classification model trained from limited source domain client's data without sharing images to an unseen target domain. To this end, our FDG, FEDA, consists of two optimisation updates during training, one at the client and another at the server level. For the client, the introduced losses aim to reduce feature complexity and condition alignment, while in the server, the regularisation limits free energy biases between source and target obtained by the global model. The remaining component of FEDAL is AL with variable budgets, which queries the server to retrieve and sample the most informative local data for the targeted client. We performed multiple experiments on FDG w/ and w/o AL and compared with both conventional FDG baselines and Federated Active Learning baselines. Our extensive quantitative experiments demonstrate the superiority of our method in accuracy and efficiency compared to the multiple contemporary methods. FEDALV manages to obtain the performance of the full training target accuracy while sampling as little as 5% of the source client's data.

📄 PDF Abstract BibTeX arXiv:2312.02247

Code (1)

razvancaramalau/fedalv 공식 구현 pytorch

Tasks

Active LearningFederated Learningimage-classificationImage Classification

Similar Papers 제목 키워드 기반

Federated Learning with Nonvacuous Generalisation Bounds

2023-10-17 · Pierre Jobic, Maxime Haddouche, Benjamin Guedj

We introduce a novel strategy to train randomised predictors in federated learning, where each node of the network aims at preserving its privacy by releasing a local predictor but keeping secret its training dataset wit…

Federated Learning

Feature-Critic Networks for Heterogeneous Domain Generalization

2019-01-31 · Yiying Li, Yongxin Yang, Wei Zhou, Timothy M. Hospedales

The well known domain shift issue causes model performance to degrade when deployed to a new target domain with different statistics to training. Domain adaptation techniques alleviate this, but need some instances from …

Domain AdaptationDomain Generalization

Domain Generalisation with Domain Augmented Supervised Contrastive Learning (Student Abstract)

2020-12-27 · Hoang Son Le, Rini Akmeliawati, Gustavo Carneiro

Domain generalisation (DG) methods address the problem of domain shift, when there is a mismatch between the distributions of training and target domains. Data augmentation approaches have emerged as a promising alternat…

Contrastive LearningData Augmentation

Domain Generalisation with Bidirectional Encoder Representations from Vision Transformers

2023-07-16 · Hamza Riaz, Alan F. Smeaton

Domain generalisation involves pooling knowledge from source domain(s) into a single model that can generalise to unseen target domain(s). Recent research in domain generalisation has faced challenges when using deep lea…

Domain Generalisation via Domain Adaptation: An Adversarial Fourier Amplitude Approach

2023-02-23 · Minyoung Kim, Da Li, Timothy Hospedales

We tackle the domain generalisation (DG) problem by posing it as a domain adaptation (DA) task where we adversarially synthesise the worst-case target domain and adapt a model to that worst-case domain, thereby improving…

Domain Adaptation