Network-Agnostic Knowledge Transfer from Latent Dataset for Medical Image Segmentation
Transfer learning often employs all or part of the weights of a pre-trained net-work to the problem at hand; this limits the flexibility of new neural architectures. We propose to transfer the knowledge of a neural network (teacher) from a latent dataset to another neural network (student) by training the student on a dataset agent whose annotations are generated by the teacher. The dataset agent requires no manual annotation and is independent of the teacher-training dataset. The student does not need to inherit the weights of the teacher, and such, the proposed algorithm can be flexibly conducted between heterogeneous neural architectures. Extensive experiments on six multi-organ medical image segmentation datasets have shown that the proposed algorithm was effective for knowledge transfer and easy to be used with fine-tuning. This algorithm has the potential to be employed in novel applications where the teacher-training dataset is not accessible, particularly in medical applications.
Code (0)
등록된 구현이 없습니다.
Tasks
Image SegmentationMedical Image SegmentationSemantic SegmentationTransfer LearningSimilar Papers 제목 키워드 기반
TATL: Task Agnostic Transfer Learning for Skin Attributes Detection
Existing skin attributes detection methods usually initialize with a pre-trained Imagenet network and then fine-tune on a medical target task. However, we argue that such approaches are suboptimal because medical dataset…
AttributeTransfer LearningEvaluating Knowledge Transfer in Neural Network for Medical Images
Deep learning and knowledge transfer techniques have permeated the field of medical imaging and are considered as key approaches for revolutionizing diagnostic imaging practices. However, there are still challenges for t…
DiagnosticTransfer LearningTask-Specific Knowledge Distillation from the Vision Foundation Model for Enhanced Medical Image Segmentation
Large-scale pre-trained models, such as Vision Foundation Models (VFMs), have demonstrated impressive performance across various downstream tasks by transferring generalized knowledge, especially when target data is limi…
Image SegmentationKnowledge DistillationMedical Image SegmentationSegmentation+1Network-Agnostic Knowledge Transfer for Medical Image Segmentation
Conventional transfer learning leverages weights of pre-trained networks, but mandates the need for similar neural architectures. Alternatively, knowledge distillation can transfer knowledge between heterogeneous network…
Image SegmentationKnowledge DistillationMedical Image SegmentationSemantic Segmentation+1MedSynapse-V: Bridging Visual Perception and Clinical Intuition via Latent Memory Evolution
High-precision medical diagnosis relies not only on static imaging features but also on the implicit diagnostic memory experts instantly invoke during image interpretation. We pinpoint a fundamental cognitive misalignmen…
Reinforcement LearningMedical Diagnosis