paper-with-me

홈 › Papers

What Makes Transfer Learning Work For Medical Images: Feature Reuse & Other Factors

2022-03-02 · CVPR 2022 1 · Christos Matsoukas, Johan Fredin Haslum, Moein Sorkhei, Magnus Söderberg, Kevin Smith

Transfer learning is a standard technique to transfer knowledge from one domain to another. For applications in medical imaging, transfer from ImageNet has become the de-facto approach, despite differences in the tasks and image characteristics between the domains. However, it is unclear what factors determine whether - and to what extent - transfer learning to the medical domain is useful. The long-standing assumption that features from the source domain get reused has recently been called into question. Through a series of experiments on several medical image benchmark datasets, we explore the relationship between transfer learning, data size, the capacity and inductive bias of the model, as well as the distance between the source and target domain. Our findings suggest that transfer learning is beneficial in most cases, and we characterize the important role feature reuse plays in its success.

📄 PDF Abstract BibTeX arXiv:2203.01825

Code (1)

chrismats/feature-reuse 공식 구현 pytorch

Tasks

Inductive BiasTransfer Learning

Similar Papers 제목 키워드 기반

Style Transfer Dataset: What Makes A Good Stylization?

2024-12-22 · Victor Kitov, Valentin Abramov, Mikhail Akhtyrchenko

We present a new dataset with the goal of advancing image style transfer - the task of rendering one image in the style of another image. The dataset covers various content and style images of different size and contains…

Style Transfer

What Can Be Transferred: Unsupervised Domain Adaptation for Endoscopic Lesions Segmentation

2020-04-24 · CVPR 2020 6 · Jiahua Dong, Yang Cong, Gan Sun, Bineng Zhong 외

Unsupervised domain adaptation has attracted growing research attention on semantic segmentation. However, 1) most existing models cannot be directly applied into lesions transfer of medical images, due to the diverse ap…

Domain AdaptationSemantic SegmentationUnsupervised Domain Adaptation

What makes instance discrimination good for transfer learning?

2020-06-11 · ICLR 2021 1 · Nanxuan Zhao, Zhirong Wu, Rynson W. H. Lau, Stephen Lin

Contrastive visual pretraining based on the instance discrimination pretext task has made significant progress. Notably, recent work on unsupervised pretraining has shown to surpass the supervised counterpart for finetun…

object-detectionObject DetectionTransfer Learning

The Importance of Image Interpretation: Patterns of Semantic Misclassification in Real-World Adversarial Images

2022-06-03 · Zhengyu Zhao, Nga Dang, Martha Larson

Adversarial images are created with the intention of causing an image classifier to produce a misclassification. In this paper, we propose that adversarial images should be evaluated based on semantic mismatch, rather th…

What makes a good concept anyway ?

2024-09-10 · Naren Khatwani, James Geller

A good medical ontology is expected to cover its domain completely and correctly. On the other hand, large ontologies are hard to build, hard to understand, and hard to maintain. Thus, adding new concepts (often multi-wo…

Bayesian Optimization