On dataset transferability in medical image classification
Current transferability estimation methods designed for natural image datasets are often suboptimal in medical image classification. These methods primarily focus on estimating the suitability of pre-trained source model features for a target dataset, which can lead to unrealistic predictions, such as suggesting that the target dataset is the best source for itself. To address this, we propose a novel transferability metric that combines feature quality with gradients to evaluate both the suitability and adaptability of source model features for target tasks. We evaluate our approach in two new scenarios: source dataset transferability for medical image classification and cross-domain transferability. Our results show that our method outperforms existing transferability metrics in both settings. We also provide insight into the factors influencing transfer performance in medical image classification, as well as the dynamics of cross-domain transfer from natural to medical images. Additionally, we provide ground-truth transfer performance benchmarking results to encourage further research into transferability estimation for medical image classification. Our code and experiments are available at https://github.com/DovileDo/transferability-in-medical-imaging.
Code (1)
Tasks
BenchmarkingClassificationimage-classificationImage ClassificationMedical Image ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Are Natural Domain Foundation Models Useful for Medical Image Classification?
The deep learning field is converging towards the use of general foundation models that can be easily adapted for diverse tasks. While this paradigm shift has become common practice within the field of natural language p…
image-classificationImage ClassificationMedical Image ClassificationEnhancing pretraining efficiency for medical image segmentation via transferability metrics
In medical image segmentation tasks, the scarcity of labeled training data poses a significant challenge when training deep neural networks. When using U-Net-style architectures, it is common practice to address this pro…
Contrastive LearningImage SegmentationMedical Image SegmentationSegmentation+1Pick the Best Pre-trained Model: Towards Transferability Estimation for Medical Image Segmentation
Transfer learning is a critical technique in training deep neural networks for the challenging medical image segmentation task that requires enormous resources. With the abundance of medical image data, many research ins…
Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation+1The Performance of Transferability Metrics does not Translate to Medical Tasks
Transfer learning boosts the performance of medical image analysis by enabling deep learning (DL) on small datasets through the knowledge acquired from large ones. As the number of DL architectures explodes, exhaustively…
Medical Image AnalysisTransfer LearningTransferability Estimation for Semantic Segmentation Task
Transferability estimation is a fundamental problem in transfer learning to predict how good the performance is when transferring a source model (or source task) to a target task. With the guidance of transferability sco…
Autonomous Drivingimage-classificationImage ClassificationMedical Image Analysis+3