Assisted Text Annotation Using Active Learning to Achieve High Quality with Little Effort
Large amounts of annotated data have become more important than ever, especially since the rise of deep learning techniques. However, manual annotations are costly. We propose a tool that enables researchers to create large, high-quality, annotated datasets with only a few manual annotations, thus strongly reducing annotation cost and effort. For this purpose, we combine an active learning (AL) approach with a pre-trained language model to semi-automatically identify annotation categories in the given text documents. To highlight our research direction's potential, we evaluate the approach on the task of identifying frames in news articles. Our preliminary results show that employing AL strongly reduces the number of annotations for correct classification of even these complex and subtle frames. On the framing dataset, the AL approach needs only 16.3\% of the annotations to reach the same performance as a model trained on the full dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningArticlesLanguage ModelingLanguage Modellingtext annotationSimilar Papers 제목 키워드 기반
Staggered NLP-assisted refinement for Clinical Annotations of Chronic Disease Events
Domain-specific annotations for NLP are often centered on real-world applications of text, and incorrect annotations may be particularly unacceptable. In medical text, the process of manual chart review (of a patient{'}s…
From Human Annotation to Automation: LLM-in-the-Loop Active Learning for Arabic Sentiment Analysis
Natural language processing (NLP), particularly sentiment analysis, plays a vital role in areas like marketing, customer service, and social media monitoring by providing insights into user opinions and emotions. However…
Arabic Sentiment AnalysisActive LearningSelf-supervised Assisted Active Learning for Skin Lesion Segmentation
Label scarcity has been a long-standing issue for biomedical image segmentation, due to high annotation costs and professional requirements. Recently, active learning (AL) strategies strive to reduce annotation costs by …
Active LearningDiversityImage SegmentationLesion Segmentation+4The INCEpTION Platform: Machine-Assisted and Knowledge-Oriented Interactive Annotation
We introduce INCEpTION, a new annotation platform for tasks including interactive and semantic annotation (e.g., concept linking, fact linking, knowledge base population, semantic frame annotation). These tasks are very …
Active LearningEntity LinkingKnowledge Base Populationtext annotationStepAL: Step-aware Active Learning for Cataract Surgical Videos
Active learning (AL) can reduce annotation costs in surgical video analysis while maintaining model performance. However, traditional AL methods, developed for images or short video clips, are suboptimal for surgical ste…
Active Learning