Active Learning for Coreference Resolution using Discrete Annotation
We improve upon pairwise annotation for active learning in coreference resolution, by asking annotators to identify mention antecedents if a presented mention pair is deemed not coreferent. This simple modification, when combined with a novel mention clustering algorithm for selecting which examples to label, is much more efficient in terms of the performance obtained per annotation budget. In experiments with existing benchmark coreference datasets, we show that the signal from this additional question leads to significant performance gains per human-annotation hour. Future work can use our annotation protocol to effectively develop coreference models for new domains. Our code is publicly available at https://github.com/belindal/discrete-active-learning-coref .
Code (1)
Tasks
Active LearningClusteringcoreference-resolutionCoreference ResolutionSimilar Papers 제목 키워드 기반
ezCoref: Towards Unifying Annotation Guidelines for Coreference Resolution
Large-scale, high-quality corpora are critical for advancing research in coreference resolution. However, existing datasets vary in their definition of coreferences and have been collected via complex and lengthy guideli…
coreference-resolutionCoreference ResolutionMarmara Turkish Coreference Corpus and Coreference Resolution Baseline
We describe the Marmara Turkish Coreference Corpus, which is an annotation of the whole METU-Sabanci Turkish Treebank with mentions and coreference chains. Collecting eight or more independent annotations for each docume…
coreference-resolutionCoreference ResolutionAdapting Coreference Resolution Models through Active Learning
Neural coreference resolution models trained on one dataset may not transfer to new, low-resource domains. Active learning mitigates this problem by sampling a small subset of data for annotators to label. While active l…
Active LearningClusteringcoreference-resolutionCoreference ResolutionOn Generalization in Coreference Resolution
While coreference resolution is defined independently of dataset domain, most models for performing coreference resolution do not transfer well to unseen domains. We consolidate a set of 8 coreference resolution datasets…
coreference-resolutionCoreference ResolutionData AugmentationFantasyCoref: Coreference Resolution on Fantasy Literature Through Omniscient Writer’s Point of View
This paper presents a new corpus and annotation guideline for a novel coreference resolution task on fictional texts, and analyzes its unique characteristics. FantasyCoref contains 211 stories of Grimms’ Fairy Tales and …
coreference-resolutionCoreference Resolution