What Makes Transfer Learning Work For Medical Images: Feature Reuse & Other Factors
Transfer learning is a standard technique to transfer knowledge from one domain to another. For applications in medical imaging, transfer from ImageNet has become the de-facto approach, despite differences in the tasks and image characteristics between the domains. However, it is unclear what factors determine whether - and to what extent - transfer learning to the medical domain is useful. The long-standing assumption that features from the source domain get reused has recently been called into question. Through a series of experiments on several medical image benchmark datasets, we explore the relationship between transfer learning, data size, the capacity and inductive bias of the model, as well as the distance between the source and target domain. Our findings suggest that transfer learning is beneficial in most cases, and we characterize the important role feature reuse plays in its success.
Code (1)
Tasks
Inductive BiasTransfer LearningSimilar Papers 제목 키워드 기반
Style Transfer Dataset: What Makes A Good Stylization?
We present a new dataset with the goal of advancing image style transfer - the task of rendering one image in the style of another image. The dataset covers various content and style images of different size and contains…
Style TransferWhat Can Be Transferred: Unsupervised Domain Adaptation for Endoscopic Lesions Segmentation
Unsupervised domain adaptation has attracted growing research attention on semantic segmentation. However, 1) most existing models cannot be directly applied into lesions transfer of medical images, due to the diverse ap…
Domain AdaptationSemantic SegmentationUnsupervised Domain AdaptationWhat makes instance discrimination good for transfer learning?
Contrastive visual pretraining based on the instance discrimination pretext task has made significant progress. Notably, recent work on unsupervised pretraining has shown to surpass the supervised counterpart for finetun…
object-detectionObject DetectionTransfer LearningThe Importance of Image Interpretation: Patterns of Semantic Misclassification in Real-World Adversarial Images
Adversarial images are created with the intention of causing an image classifier to produce a misclassification. In this paper, we propose that adversarial images should be evaluated based on semantic mismatch, rather th…
What makes a good concept anyway ?
A good medical ontology is expected to cover its domain completely and correctly. On the other hand, large ontologies are hard to build, hard to understand, and hard to maintain. Thus, adding new concepts (often multi-wo…
Bayesian Optimization