Is More Data Better? Using Transformers-Based Active Learning for Efficient and Effective Detection of Abusive Language
Annotating abusive language content can cause psychological harm; yet, most machine learning research has prioritized efficacy (i.e., F1 or accuracy scores) while little research has analyzed data efficiency (i.e., how to minimize annotation requirements).In this paper, we use a series of simulated experiments over two datasets at varying percentages of abuse to demonstrate that transformers-based active learning is a promising approach that maintains high efficacy but substantially raises efficiency, requiring a fraction of labeled data to reach equivalent performance to passive training over the full dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Abusive LanguageActive LearningSimilar Papers 제목 키워드 기반
Is More Data Better? Re-thinking the Importance of Efficiency in Abusive Language Detection with Transformers-Based Active Learning
Annotating abusive language is expensive, logistically complex and creates a risk of psychological harm. However, most machine learning research has prioritized maximizing effectiveness (i.e., F1 or accuracy score) rathe…
Abusive LanguageActive LearningInteractive Image Segmentation with Cross-Modality Vision Transformers
Interactive image segmentation aims to segment the target from the background with the manual guidance, which takes as input multimodal data such as images, clicks, scribbles, and bounding boxes. Recently, vision transfo…
Image SegmentationInteractive SegmentationSegmentationSemantic SegmentationRevisiting Uncertainty-based Query Strategies for Active Learning with Transformers
Active learning is the iterative construction of a classification model through targeted labeling, enabling significant labeling cost savings. As most research on active learning has been carried out before transformer-b…
Active LearningClassificationSentence Classificationtext-classification+1GiT: Graph Interactive Transformer for Vehicle Re-identification
Transformers are more and more popular in computer vision, which treat an image as a sequence of patches and learn robust global features from the sequence. However, pure transformers are not entirely suitable for vehicl…
Person Re-IdentificationVehicle Re-IdentificationDisentangling Visual Transformers: Patch-level Interpretability for Image Classification
Visual transformers have achieved remarkable performance in image classification tasks, but this performance gain has come at the cost of interpretability. One of the main obstacles to the interpretation of transformers …
image-classificationImage Classification