paper-with-me

Papers

AnchorAL: Computationally Efficient Active Learning for Large and Imbalanced Datasets

2024-04-08 · Pietro Lesci, Andreas Vlachos

Active learning for imbalanced classification tasks is challenging as the minority classes naturally occur rarely. Gathering a large pool of unlabelled data is thus essential to capture minority instances. Standard pool-based active learning is computationally expensive on large pools and often reaches low accuracy by overfitting the initial decision boundary, thus failing to explore the input space and find minority instances. To address these issues we propose AnchorAL. At each iteration, AnchorAL chooses class-specific instances from the labelled set, or anchors, and retrieves the most similar unlabelled instances from the pool. This resulting subpool is then used for active learning. Using a small, fixed-sized subpool AnchorAL allows scaling any active learning strategy to large pools. By dynamically selecting different anchors at each iteration it promotes class balance and prevents overfitting the initial decision boundary, thus promoting the discovery of new clusters of minority instances. In experiments across different classification tasks, active learning strategies, and model architectures AnchorAL is (i) faster, often reducing runtime from hours to minutes, (ii) trains more performant models, (iii) and returns more balanced datasets than competing methods.

📄 PDF Abstract BibTeX arXiv:2404.05623

Code (2)

pietrolesci/anchoral 공식 구현 pytorch
webis-de/small-text pytorch

Tasks

Active Learningimbalanced classification

Similar Papers 제목 키워드 기반

Active learning for imbalanced data under cold start

2021-07-16 · Ricardo Barata, Miguel Leite, Ricardo Pacheco, Marco O. P. Sampaio 외

Modern systems that rely on Machine Learning (ML) for predictive modelling, may suffer from the cold-start problem: supervised models work well but, initially, there are no labels, which are costly or slow to obtain. Thi…

Active LearningFraud Detection

Minority Class Oriented Active Learning for Imbalanced Datasets

2022-02-01 · Umang Aggarwal, Adrian Popescu, Céline Hudelot

Active learning aims to optimize the dataset annotation process when resources are constrained. Most existing methods are designed for balanced datasets. Their practical applicability is limited by the fact that a majori…

Active LearningTransfer Learning

Class-Balanced Active Learning for Image Classification

2021-10-09 · Javad Zolfaghari Bengar, Joost Van de Weijer, Laura Lopez Fuentes, Bogdan Raducanu

Active learning aims to reduce the labeling effort that is required to train algorithms by learning an acquisition function selecting the most relevant data for which a label should be requested from a large unlabeled da…

Active LearningClassificationimage-classificationImage Classification

Active Class Incremental Learning for Imbalanced Datasets

2020-08-25 · Eden Belouadah, Adrian Popescu, Umang Aggarwal, Léo Saci

Incremental Learning (IL) allows AI systems to adapt to streamed data. Most existing algorithms make two strong hypotheses which reduce the realism of the incremental scenario: (1) new data are assumed to be readily anno…

class-incremental learningClass Incremental LearningIncremental LearningKnowledge Distillation

Learning from the Best: Active Learning for Wireless Communications

2024-01-23 · Nasim Soltani, Jifan Zhang, Batool Salehi, Debashri Roy 외

Collecting an over-the-air wireless communications training dataset for deep learning-based communication tasks is relatively simple. However, labeling the dataset requires expert involvement and domain knowledge, may in…

Active LearningDeep Learning