Benchmarking Multi-Domain Active Learning on Image Classification
Active learning aims to enhance model performance by strategically labeling informative data points. While extensively studied, its effectiveness on large-scale, real-world datasets remains underexplored. Existing research primarily focuses on single-source data, ignoring the multi-domain nature of real-world data. We introduce a multi-domain active learning benchmark to bridge this gap. Our benchmark demonstrates that traditional single-domain active learning strategies are often less effective than random selection in multi-domain scenarios. We also introduce CLIP-GeoYFCC, a novel large-scale image dataset built around geographical domains, in contrast to existing genre-based domain datasets. Analysis on our benchmark shows that all multi-domain strategies exhibit significant tradeoffs, with no strategy outperforming across all datasets or all metrics, emphasizing the need for future research.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningAllBenchmarkingClassificationimage-classificationImage ClassificationSimilar Papers 제목 키워드 기반
Tune It or Don't Use It: Benchmarking Data-Efficient Image Classification
Data-efficient image classification using deep neural networks in settings, where only small amounts of labeled data are available, has been an active research area in the recent past. However, an objective comparison be…
Benchmarkingimage-classificationImage ClassificationSmall Data Image ClassificationD3GU: Multi-Target Active Domain Adaptation via Enhancing Domain Alignment
Unsupervised domain adaptation (UDA) for image classification has made remarkable progress in transferring classification knowledge from a labeled source domain to an unlabeled target domain, thanks to effective domain a…
ClassificationDomain Adaptationimage-classificationImage Classification+1Active Multi-Kernel Domain Adaptation for Hyperspectral Image Classification
Recent years have witnessed the quick progress of the hyperspectral images (HSI) classification. Most of existing studies either heavily rely on the expensive label information using the supervised learning or can hardly…
Active LearningClassificationDomain AdaptationGeneral Classification+3Failure Detection in Medical Image Classification: A Reality Check and Benchmarking Testbed
Failure detection in automated image classification is a critical safeguard for clinical deployment. Detected failure cases can be referred to human assessment, ensuring patient safety in computer-aided clinical decision…
BenchmarkingBinary ClassificationDecision MakingGeneral Classification+4Benchmarking Vision-Language Contrastive Methods for Medical Representation Learning
We perform a comprehensive benchmarking of contrastive frameworks for learning multimodal representations in the medical domain. Through this study, we aim to answer the following research questions: (i) How transferable…
BenchmarkingContrastive LearningImage RetrievalImage to text+4