Cold Start Active Learning Strategies in the Context of Imbalanced Classification
We present novel active learning strategies dedicated to providing a solution to the cold start stage, i.e. initializing the classification of a large set of data with no attached labels. Moreover, proposed strategies are designed to handle an imbalanced context in which random selection is highly inefficient. Specifically, our active learning iterations address label scarcity and imbalance using element scores, combining information extracted from a clustering structure to a label propagation model. The strategy is illustrated by a case study on annotating Twitter content w.r.t. testimonies of a real flood event. We show that our method effectively copes with class imbalance, by boosting the recall of samples from the minority class.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningClusteringimbalanced classificationSimilar Papers 제목 키워드 기반
Active learning for imbalanced data under cold start
Modern systems that rely on Machine Learning (ML) for predictive modelling, may suffer from the cold-start problem: supervised models work well but, initially, there are no labels, which are costly or slow to obtain. Thi…
Active LearningFraud DetectionCOLosSAL: A Benchmark for Cold-start Active Learning for 3D Medical Image Segmentation
Medical image segmentation is a critical task in medical image analysis. In recent years, deep learning based approaches have shown exceptional performance when trained on a fully-annotated dataset. However, data annotat…
Active LearningImage SegmentationMedical Image AnalysisMedical Image Segmentation+2Cold-Start Active Preference Learning in Socio-Economic Domains
Active preference learning offers an efficient approach to modeling preferences, but it is hindered by the cold-start problem, which leads to a marked decline in performance when no initial labeled data are available. Wh…
Active LearningMaking Your First Choice: To Address Cold Start Problem in Vision Active Learning
Active learning promises to improve annotation efficiency by iteratively selecting the most important data to be annotated first. However, we uncover a striking contradiction to this promise: active learning fails to sel…
Active LearningContrastive LearningDiversityPOSO: Personalized Cold Start Modules for Large-scale Recommender Systems
Recommendation for new users, also called user cold start, has been a well-recognized challenge for online recommender systems. Most existing methods view the crux as the lack of initial data. However, in this paper, we …
Recommendation Systems