Federated Cycling (FedCy): Semi-supervised Federated Learning of Surgical Phases
Recent advancements in deep learning methods bring computer-assistance a step closer to fulfilling promises of safer surgical procedures. However, the generalizability of such methods is often dependent on training on diverse datasets from multiple medical institutions, which is a restrictive requirement considering the sensitive nature of medical data. Recently proposed collaborative learning methods such as Federated Learning (FL) allow for training on remote datasets without the need to explicitly share data. Even so, data annotation still represents a bottleneck, particularly in medicine and surgery where clinical expertise is often required. With these constraints in mind, we propose FedCy, a federated semi-supervised learning (FSSL) method that combines FL and self-supervised learning to exploit a decentralized dataset of both labeled and unlabeled videos, thereby improving performance on the task of surgical phase recognition. By leveraging temporal patterns in the labeled data, FedCy helps guide unsupervised training on unlabeled data towards learning task-specific features for phase recognition. We demonstrate significant performance gains over state-of-the-art FSSL methods on the task of automatic recognition of surgical phases using a newly collected multi-institutional dataset of laparoscopic cholecystectomy videos. Furthermore, we demonstrate that our approach also learns more generalizable features when tested on data from an unseen domain.
Code (0)
등록된 구현이 없습니다.
Tasks
Federated LearningSelf-Supervised LearningSurgical phase recognitionSimilar Papers 제목 키워드 기반
Federated Contrastive Learning for Privacy-Preserving Unpaired Image-to-Image Translation
The goal of an unsupervised image-to-image translation (I2I) is to convert an input image in a specific domain to a target domain using a neural network trained with unpaired data. Existing I2I methods usually require a …
Contrastive LearningImage-to-Image TranslationPrivacy PreservingTranslation+1Save It All: Enabling Full Parameter Tuning for Federated Large Language Models via Cycle Block Gradient Descent
The advent of large language models (LLMs) has revolutionized the deep learning paradigm, yielding impressive results across a wide array of tasks. However, the pre-training or fine-tuning of LLMs within a federated lear…
AllFederated LearningFedParsing: a Semi-Supervised Federated Learning Model on Semantic Parsing
Although many semantic parsing models have been proven to work effectively on "NL-to-SQL", the limitation of annotated datasets remains a great challenge. In many semi-supervised models, while they use unlabeled data to …
Federated LearningSemantic ParsingFederated Knowledge Recycling: Privacy-Preserving Synthetic Data Sharing
Federated learning has emerged as a paradigm for collaborative learning, enabling the development of robust models without the need to centralise sensitive data. However, conventional federated learning techniques have p…
Federated LearningPrivacy PreservingFederated Semi-Supervised Learning with Inter-Client Consistency & Disjoint Learning
While existing federated learning approaches mostly require that clients have fully-labeled data to train on, in realistic settings, data obtained at the client-side often comes without any accompanying labels. Such defi…
Federated Learning