paper-with-me

홈 › Papers

Pseudo-Data based Self-Supervised Federated Learning for Classification of Histopathological Images

2022-05-31 · Jun Shi, Yuanming Zhang, Zheng Li, Xiangmin Han, Saisai Ding, Jun Wang, Shihui Ying

Computer-aided diagnosis (CAD) can help pathologists improve diagnostic accuracy together with consistency and repeatability for cancers. However, the CAD models trained with the histopathological images only from a single center (hospital) generally suffer from the generalization problem due to the straining inconsistencies among different centers. In this work, we propose a pseudo-data based self-supervised federated learning (FL) framework, named SSL-FT-BT, to improve both the diagnostic accuracy and generalization of CAD models. Specifically, the pseudo histopathological images are generated from each center, which contains inherent and specific properties corresponding to the real images in this center, but does not include the privacy information. These pseudo images are then shared in the central server for self-supervised learning (SSL). A multi-task SSL is then designed to fully learn both the center-specific information and common inherent representation according to the data characteristics. Moreover, a novel Barlow Twins based FL (FL-BT) algorithm is proposed to improve the local training for the CAD model in each center by conducting contrastive learning, which benefits the optimization of the global model in the FL procedure. The experimental results on three public histopathological image datasets indicate the effectiveness of the proposed SSL-FL-BT on both diagnostic accuracy and generalization.

📄 PDF Abstract BibTeX arXiv:2205.15530

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningDiagnosticFederated LearningSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Barlow Twins Barlow Twins is a self-supervised learning method that applies redundancy-reduction — a principle first proposed in neuroscience — to self supervised learning. The objective…

Similar Papers 제목 키워드 기반

Federated Self-Supervised Learning for Acoustic Event Classification

2022-03-22 · Meng Feng, Chieh-Chi Kao, Qingming Tang, Ming Sun 외

Standard acoustic event classification (AEC) solutions require large-scale collection of data from client devices for model optimization. Federated learning (FL) is a compelling framework that decouples data collection a…

ClassificationContinual LearningFederated LearningModel Optimization+1

Unsupervised Representation Learning Meets Pseudo-Label Supervised Self-Distillation: A New Approach to Rare Disease Classification

2021-10-09 · Jinghan Sun, Dong Wei, Kai Ma, Liansheng Wang 외

Rare diseases are characterized by low prevalence and are often chronically debilitating or life-threatening. Imaging-based classification of rare diseases is challenging due to the severe shortage in training examples. …

ClassificationFew-Shot LearningPseudo LabelRepresentation Learning

Learning to Self-Train for Semi-Supervised Few-Shot Classification

2019-06-03 · NeurIPS 2019 12 · Xinzhe Li, Qianru Sun, Yaoyao Liu, Shibao Zheng 외

Few-shot classification (FSC) is challenging due to the scarcity of labeled training data (e.g. only one labeled data point per class). Meta-learning has shown to achieve promising results by learning to initialize a cla…

ClassificationGeneral ClassificationMeta-Learning

Distilling Self-Supervised Vision Transformers for Weakly-Supervised Few-Shot Classification & Segmentation

2023-07-07 · CVPR 2023 1 · Dahyun Kang, Piotr Koniusz, Minsu Cho, Naila Murray

We address the task of weakly-supervised few-shot image classification and segmentation, by leveraging a Vision Transformer (ViT) pretrained with self-supervision. Our proposed method takes token representations from the…

Few-Shot Image Classificationimage-classificationImage ClassificationPseudo Label+1

Self Meta Pseudo Labels: Meta Pseudo Labels Without The Teacher

2022-12-27 · Kei-Sing Ng, Qingchen Wang

We present Self Meta Pseudo Labels, a novel semi-supervised learning method similar to Meta Pseudo Labels but without the teacher model. We introduce a novel way to use a single model for both generating pseudo labels an…

Semi-Supervised Image Classification