BERT for Coreference Resolution: Baselines and Analysis
We apply BERT to coreference resolution, achieving strong improvements on the OntoNotes (+3.9 F1) and GAP (+11.5 F1) benchmarks. A qualitative analysis of model predictions indicates that, compared to ELMo and BERT-base, BERT-large is particularly better at distinguishing between related but distinct entities (e.g., President and CEO). However, there is still room for improvement in modeling document-level context, conversations, and mention paraphrasing. Our code and models are publicly available.
Code (2)
Tasks
Coreference ResolutionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Exploring Span Representations in Neural Coreference Resolution
In coreference resolution, span representations play a key role to predict coreference links accurately. We present a thorough examination of the span representation derived by applying BERT on coreference resolution (Jo…
coreference-resolutionCoreference ResolutionSpanBERT: Improving Pre-training by Representing and Predicting Spans
We present SpanBERT, a pre-training method that is designed to better represent and predict spans of text. Our approach extends BERT by (1) masking contiguous random spans, rather than random tokens, and (2) training the…
Coreference ResolutionLinguistic AcceptabilityNatural Language InferenceOpen-Domain Question Answering+6Coreference Resolution in Research Papers from Multiple Domains
Coreference resolution is essential for automatic text understanding to facilitate high-level information retrieval tasks such as text summarisation or question answering. Previous work indicates that the performance of …
coreference-resolutionCoreference ResolutionInformation RetrievalRetrieval+1D-Coref: A Fast and Lightweight Coreference Resolution Model using DistilBERT
Smart devices are often deployed in some edge-devices, which require quality solutions in limited amount of memory usage. In most of the user-interaction based smart devices, coreference resolution is often required. Kee…
coreference-resolutionCoreference ResolutionWord-Level Coreference Resolution
Recent coreference resolution models rely heavily on span representations to find coreference links between word spans. As the number of spans is $O(n^2)$ in the length of text and the number of potential links is $O(n^4…
coreference-resolutionCoreference Resolution