paper-with-me

홈 › Papers

Benchmarking Multi-Domain Active Learning on Image Classification

2023-12-01 · Jiayi Li, Rohan Taori, Tatsunori B. Hashimoto

Active learning aims to enhance model performance by strategically labeling informative data points. While extensively studied, its effectiveness on large-scale, real-world datasets remains underexplored. Existing research primarily focuses on single-source data, ignoring the multi-domain nature of real-world data. We introduce a multi-domain active learning benchmark to bridge this gap. Our benchmark demonstrates that traditional single-domain active learning strategies are often less effective than random selection in multi-domain scenarios. We also introduce CLIP-GeoYFCC, a novel large-scale image dataset built around geographical domains, in contrast to existing genre-based domain datasets. Analysis on our benchmark shows that all multi-domain strategies exhibit significant tradeoffs, with no strategy outperforming across all datasets or all metrics, emphasizing the need for future research.

📄 PDF Abstract BibTeX arXiv:2312.00364

Code (0)

등록된 구현이 없습니다.

Tasks

Active LearningAllBenchmarkingClassificationimage-classificationImage Classification

Similar Papers 제목 키워드 기반

Tune It or Don't Use It: Benchmarking Data-Efficient Image Classification

2021-08-30 · Lorenzo Brigato, Björn Barz, Luca Iocchi, Joachim Denzler

Data-efficient image classification using deep neural networks in settings, where only small amounts of labeled data are available, has been an active research area in the recent past. However, an objective comparison be…

Benchmarkingimage-classificationImage ClassificationSmall Data Image Classification

D3GU: Multi-Target Active Domain Adaptation via Enhancing Domain Alignment

2024-01-10 · Lin Zhang, Linghan Xu, Saman Motamed, Shayok Chakraborty 외

Unsupervised domain adaptation (UDA) for image classification has made remarkable progress in transferring classification knowledge from a labeled source domain to an unlabeled target domain, thanks to effective domain a…

ClassificationDomain Adaptationimage-classificationImage Classification+1

Active Multi-Kernel Domain Adaptation for Hyperspectral Image Classification

2019-04-10 · Cheng Deng, Xianglong Liu, Chao Li, DaCheng Tao

Recent years have witnessed the quick progress of the hyperspectral images (HSI) classification. Most of existing studies either heavily rely on the expensive label information using the supervised learning or can hardly…

Active LearningClassificationDomain AdaptationGeneral Classification+3

Failure Detection in Medical Image Classification: A Reality Check and Benchmarking Testbed

2022-05-27 · Melanie Bernhardt, Fabio De Sousa Ribeiro, Ben Glocker

Failure detection in automated image classification is a critical safeguard for clinical deployment. Detected failure cases can be referred to human assessment, ensuring patient safety in computer-aided clinical decision…

BenchmarkingBinary ClassificationDecision MakingGeneral Classification+4

Benchmarking Vision-Language Contrastive Methods for Medical Representation Learning

2024-06-11 · Shuvendu Roy, Yasaman Parhizkar, Franklin Ogidi, Vahid Reza Khazaie 외

We perform a comprehensive benchmarking of contrastive frameworks for learning multimodal representations in the medical domain. Through this study, we aim to answer the following research questions: (i) How transferable…

BenchmarkingContrastive LearningImage RetrievalImage to text+4