paper-with-me

Transferability

1개 벤치마크 · 논문 6편 · 이 태스크의 논문 보기 →

Benchmarks

Most implemented

Ranking Neural Checkpoints

2020-11-23 · 구현 1개

Papers

ETran: Energy-Based Transferability Estimation

2023-08-03 · ICCV 2023 1 · Mohsen Gholami, Mohammad Akbari, Xinglu Wang, Behnam Kamranian 외

This paper addresses the problem of ranking pre-trained models for object detection and image classification. Selecting the best pre-trained model by fine-tuning is an expensive and time-consuming task. Previous works ha…

Classificationimage-classificationImage ClassificationObject+4

Not All Models Are Equal: Predicting Model Transferability in a Self-challenging Fisher Space

2022-07-07 · Wenqi Shao, Xun Zhao, Yixiao Ge, Zhaoyang Zhang 외

This paper addresses an important problem of ranking the pre-trained deep neural networks and screening the most transferable ones for downstream tasks. It is challenging because the ground-truth model ranking for each t…

AllTransferability

PACTran: PAC-Bayesian Metrics for Estimating the Transferability of Pretrained Models to Classification Tasks

2022-03-10 · Nan Ding, Xi Chen, Tomer Levinboim, Beer Changpinyo 외

With the increasing abundance of pretrained models in recent years, the problem of selecting the best pretrained checkpoint for a particular downstream classification task has been gaining increased attention. Although s…

Learning TheoryModel SelectionTransferabilityTransfer Learning

LogME: Practical Assessment of Pre-trained Models for Transfer Learning

2021-02-22 · Kaichao You, Yong liu, Jianmin Wang, Mingsheng Long

This paper studies task adaptive pre-trained model selection, an underexplored problem of assessing pre-trained models for the target task and select best ones from the model zoo \emph{without fine-tuning}. A few pilot w…

Model SelectionregressionTransferabilityTransfer Learning

Ranking Neural Checkpoints

2020-11-23 · CVPR 2021 1 · Yandong Li, Xuhui Jia, Ruoxin Sang, Yukun Zhu 외

This paper is concerned with ranking many pre-trained deep neural networks (DNNs), called checkpoints, for the transfer learning to a downstream task. Thanks to the broad use of DNNs, we may easily collect hundreds of ch…

TransferabilityTransfer Learning

LEEP: A New Measure to Evaluate Transferability of Learned Representations

2020-02-27 · ICML 2020 1 · Cuong V. Nguyen, Tal Hassner, Matthias Seeger, Cedric Archambeau

We introduce a new measure to evaluate the transferability of representations learned by classifiers. Our measure, the Log Expected Empirical Prediction (LEEP), is simple and easy to compute: when given a classifier trai…

TransferabilityTransfer Learning