Tuning Deep Active Learning for Semantic Role Labeling
Active learning has been shown to reduce annotation requirements for numerous natural language processing tasks, including semantic role labeling (SRL). SRL involves labeling argument spans for potentially multiple predicates in a sentence, which makes it challenging to aggregate the numerous decisions into a single score for determining new instances to annotate. In this paper, we apply two ways of aggregating scores across multiple predicates in order to choose query sentences with two methods of estimating model certainty: using the neural network’s outputs and using dropout-based Bayesian Active Learning by Disagreement. We compare these methods with three passive baselines — random sentence selection, random whole-document selection, and selecting sentences with the most predicates — and analyse the effect these strategies have on the learning curve with respect to reducing the number of annotated sentences and predicates to achieve high performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningSemantic Role LabelingSentenceSimilar Papers 제목 키워드 기반
Multi-Task Active Learning for Neural Semantic Role Labeling on Low Resource Conversational Corpus
Most Semantic Role Labeling (SRL) approaches are supervised methods which require a significant amount of annotated corpus, and the annotation requires linguistic expertise. In this paper, we propose a Multi-Task Active …
Active LearningMulti-Task LearningSemantic Role LabelingMulti-Task Learning for Joint Semantic Role and Proto-Role Labeling
We put forward an end-to-end multi-step machine learning model which jointly labels semantic roles and the proto-roles of Dowty (1991), given a sentence and the predicates therein. Our best architecture first learns argu…
Multi-Task LearningSentenceTransfer LearningCross-lingual Transfer Learning for Semantic Role Labeling in Russian
This work is devoted to semantic role labeling (SRL) task in Russian. We investigate the role of transfer learning strategies between English FrameNet and Russian FrameBank corpora. We perform experiments with embeddings…
Cross-Lingual TransferSemantic Role LabelingTransfer LearningXLM-RFine-tuning and Sampling Strategies for Multimodal Role Labeling of Entities under Class Imbalance
We propose our solution to the multimodal semantic role labeling task from the CONSTRAINT’22 workshop. The task aims at classifying entities in memes into classes such as “hero” and “villain”. We use several pre-trained …
Semantic Role LabelingORIS: Online Active Learning Using Reinforcement Learning-based Inclusive Sampling for Robust Streaming Analytics System
Effective labeled data collection plays a critical role in developing and fine-tuning robust streaming analytics systems. However, continuously labeling documents to filter relevant information poses significant challeng…
Active LearningEmotion Recognition