paper-with-me

Papers

Exploring Multiple Strategies to Improve Multilingual Coreference Resolution in CorefUD

2024-08-29 · Ondřej Pražák, Miloslav Konopík, Pavel Král

Coreference resolution, the task of identifying expressions in text that refer to the same entity, is a critical component in various natural language processing applications. This paper presents a novel end-to-end neural coreference resolution system utilizing the CorefUD 1.1 dataset, which spans 17 datasets across 12 languages. The proposed model is based on the standard end-to-end neural coreference resolution system. We first establish baseline models, including monolingual and cross-lingual variations, and then propose several extensions to enhance performance across diverse linguistic contexts. These extensions include cross-lingual training, incorporation of syntactic information, a Span2Head model for optimized headword prediction, and advanced singleton modeling. We also experiment with headword span representation and long-documents modeling through overlapping segments. The proposed extensions, particularly the heads-only approach, singleton modeling, and long document prediction, significantly improve performance across most datasets. We also perform zero-shot cross-lingual experiments, highlighting the potential and limitations of cross-lingual transfer in coreference resolution. Our findings contribute to the development of robust and scalable coreference systems for multilingual coreference resolution. Finally, we evaluate our model on the CorefUD 1.1 test set and surpass the best model from the CRAC 2023 shared task of comparable size by a large margin.

📄 PDF Abstract BibTeX arXiv:2408.16893

Code (1)

ondfa/coref-multiling 공식 구현 pytorch

Tasks

coreference-resolutionCoreference ResolutionCross-Lingual Transfer

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Exploring Pre-Trained Transformers and Bilingual Transfer Learning for Arabic Coreference Resolution

2021-11-01 · CRAC (ACL) 2021 11 · Bonan Min

In this paper, we develop bilingual transfer learning approaches to improve Arabic coreference resolution by leveraging additional English annotation via bilingual or multilingual pre-trained transformers. We show that b…

coreference-resolutionCoreference ResolutionTransfer Learning

Investigating Multilingual Coreference Resolution by Universal Annotations

2023-10-26 · Haixia Chai, Michael Strube

Multilingual coreference resolution (MCR) has been a long-standing and challenging task. With the newly proposed multilingual coreference dataset, CorefUD (Nedoluzhko et al., 2022), we conduct an investigation into the t…

coreference-resolutionCoreference Resolution

ÚFAL CorPipe at CRAC 2023: Larger Context Improves Multilingual Coreference Resolution

2023-11-24 · Milan Straka

We present CorPipe, the winning entry to the CRAC 2023 Shared Task on Multilingual Coreference Resolution. Our system is an improved version of our earlier multilingual coreference pipeline, and it surpasses other partic…

coreference-resolutionCoreference ResolutionLanguage ModelingLanguage Modelling

Coreference Resolution for Polish: Improvements within the CRAC 2022 Shared Task

2022-10-01 · CRAC (ACL) 2022 10 · Karol Saputa

The paper presents our system for coreference resolution in Polish. We compare the system with previous works for the Polish language as well as with the multilingual approach in the CRAC 2022 Shared Task on Multilingual…

coreference-resolutionCoreference Resolution

End-to-end Multilingual Coreference Resolution with Mention Head Prediction

2022-09-26 · CRAC (ACL) 2022 10 · Ondřej Pražák, Miloslav Konopík

This paper describes our approach to the CRAC 2022 Shared Task on Multilingual Coreference Resolution. Our model is based on a state-of-the-art end-to-end coreference resolution system. Apart from joined multilingual tra…

coreference-resolutionCoreference Resolution