Efficiently labelling sequences using semi-supervised active learning
In natural language processing, deep learning methods are popular for sequence labelling tasks but training them usually requires large amounts of labelled data. Active learning can reduce the amount of labelled training data required by iteratively acquiring labels for the data points a model is most uncertain about. However, active learning methods usually use supervised training and ignore the data points which have not yet been labelled. We propose an approach to sequence labelling using active learning which incorporates both labelled and unlabelled data. We train a locally-contextual conditional random field with deep nonlinear potentials in a semi-supervised manner, treating the missing labels of the unlabelled sentences as latent variables. Our semi-supervised active learning method is able to leverage the sentences which have not yet been labelled to improve on the performance of purely supervised active learning. We also find that using an additional, larger pool of unlabelled data provides further improvements. Across a variety of sequence labelling tasks, our method is consistently able to match 97% of the performance of state of the art models while using less than 30% of the amount of training data.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningMissing LabelsSimilar Papers 제목 키워드 기반
SelfPrompt: Confidence-Aware Semi-Supervised Tuning for Robust Vision-Language Model Adaptation
We present SelfPrompt, a novel prompt-tuning approach for vision-language models (VLMs) in a semi-supervised learning setup. Existing methods for tuning VLMs in semi-supervised setups struggle with the negative impact of…
Language ModelingLanguage ModellingPseudo LabelWeakly-supervised LearningSemi-Supervised Active Learning for Semantic Segmentation in Unknown Environments Using Informative Path Planning
Semantic segmentation enables robots to perceive and reason about their environments beyond geometry. Most of such systems build upon deep learning approaches. As autonomous robots are commonly deployed in initially unkn…
Active LearningSegmentationSemantic SegmentationAnomalyMatch: Discovering Rare Objects of Interest with Semi-supervised and Active Learning
Anomaly detection in large datasets is essential in fields such as astronomy and computer vision; however, supervised methods typically require extensive anomaly labelling, which is often impractical. We present AnomalyM…
Active LearningAnomaly DetectionAstronomyBinary Classification+1Integrating Semi-Supervised and Active Learning for Semantic Segmentation
In this paper, we propose a novel active learning approach integrated with an improved semi-supervised learning framework to reduce the cost of manual annotation and enhance model performance. Our proposed approach effec…
Active LearningPseudo LabelSemantic SegmentationConsistency-Based Semi-supervised Evidential Active Learning for Diagnostic Radiograph Classification
Deep learning approaches achieve state-of-the-art performance for classifying radiology images, but rely on large labelled datasets that require resource-intensive annotation by specialists. Both semi-supervised learning…
Active LearningDiagnosticimage-classificationImage Classification+2