paper-with-me

Papers

Prototype-Guided and Lightweight Adapters for Inherent Interpretation and Generalisation in Federated Learning

2025-07-08 · Samuel Ofosu Mensah, Kerol Djoumessi, Philipp Berens

Federated learning (FL) provides a promising paradigm for collaboratively training machine learning models across distributed data sources while maintaining privacy. Nevertheless, real-world FL often faces major challenges including communication overhead during the transfer of large model parameters and statistical heterogeneity, arising from non-identical independent data distributions across clients. In this work, we propose an FL framework that 1) provides inherent interpretations using prototypes, and 2) tackles statistical heterogeneity by utilising lightweight adapter modules to act as compressed surrogates of local models and guide clients to achieve generalisation despite varying client distribution. Each client locally refines its model by aligning class embeddings toward prototype representations and simultaneously adjust the lightweight adapter. Our approach replaces the need to communicate entire model weights with prototypes and lightweight adapters. This design ensures that each client's model aligns with a globally shared structure while minimising communication load and providing inherent interpretations. Moreover, we conducted our experiments on a real-world retinal fundus image dataset, which provides clinical-site information. We demonstrate inherent interpretable capabilities and perform a classification task, which shows improvements in accuracy over baseline algorithms.

📄 PDF Abstract BibTeX arXiv:2507.05852

Code (1)

berenslab/fedadapterproto 공식 구현 pytorch

Tasks

Federated Learning

Methods 이 논문이 사용한 방법론

Adapter 설명 없음

Similar Papers 제목 키워드 기반

Learning Self-Interpretation from Interpretability Artifacts: Training Lightweight Adapters on Vector-Label Pairs

2026-02-10 · Keenan Pepper, Alex McKenzie, Florin Pop, Stijn Servaes 외 arxiv

Self-interpretation methods prompt language models to describe their own internal states, but remain unreliable due to hyperparameter sensitivity. We show that training lightweight adapters on interpretability artifacts,…

AdapTS: Lightweight Teacher-Student Approach for Multi-Class and Continual Visual Anomaly Detection

2026-03-18 · Manuel Barusco, Davide Dalle Pezze, Francesco Borsatti, Gian Antonio Susto arxiv

Visual Anomaly Detection (VAD) is crucial for industrial inspection, yet most existing methods are limited to single-category scenarios, failing to address the multi-class and continual learning demands of real-world env…

Continual LearningAnomaly Detection

ConStruct: Structural Distillation of Foundation Models for Prototype-Based Weakly Supervised Histopathology Segmentation

2025-12-11 · Khang Le, Ha Thach, Anh M. Vu, Trang T. K. Vo 외 arxiv

Weakly supervised semantic segmentation (WSSS) in histopathology relies heavily on classification backbones, yet these models often localize only the most discriminative regions and struggle to capture the full spatial e…

Semantic Segmentation

DIMoE-Adapters: Dynamic Expert Evolution for Continual Learning in Vision-Language Models

2026-05-08 · Mengxin Qin, Xiang Zhang, Xi Wang, Kun Wei 외 arxiv

Continual learning enables vision-language models to accumulate knowledge and adapt to evolving tasks without retraining from scratch. However, in multi-domain task-incremental learning, large domain shifts intensify the…

Incremental LearningContinual Learning

Federated Cross-Modal Retrieval with Missing Modalities via Semantic Routing and Adapter Personalization

2026-04-24 · Hefeng Zhou, Xuan Liu, Sicheng Chen, Wutong Zhang 외 arxiv

Federated cross-modal retrieval faces severe challenges from heterogeneous client data, particularly non-IID semantic distributions and missing modalities. Under such heterogeneity, a single global model is often insuffi…

Cross-Modal Retrieval