Contrastive Entity Coreference and Disambiguation for Historical Texts
Massive-scale historical document collections are crucial for social science research. Despite increasing digitization, these documents typically lack unique cross-document identifiers for individuals mentioned within the texts, as well as individual identifiers from external knowledgebases like Wikipedia/Wikidata. Existing entity disambiguation methods often fall short in accuracy for historical documents, which are replete with individuals not remembered in contemporary knowledgebases. This study makes three key contributions to improve cross-document coreference resolution and disambiguation in historical texts: a massive-scale training dataset replete with hard negatives - that sources over 190 million entity pairs from Wikipedia contexts and disambiguation pages - high-quality evaluation data from hand-labeled historical newswire articles, and trained models evaluated on this historical benchmark. We contrastively train bi-encoder models for coreferencing and disambiguating individuals in historical texts, achieving accurate, scalable performance that identifies out-of-knowledgebase individuals. Our approach significantly surpasses other entity disambiguation models on our historical newswire benchmark. Our models also demonstrate competitive performance on modern entity disambiguation benchmarks, particularly certain news disambiguation datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Articlescoreference-resolutionCoreference ResolutionCross Document Coreference ResolutionEntity DisambiguationSimilar Papers 제목 키워드 기반
Resources and Evaluations for Danish Entity Resolution
Automatic coreference resolution is understudied in Danish even though most of the Danish Dependency Treebank (Buch-Kromann, 2003) is annotated with coreference relations. This paper describes a conversion of its partial…
coreference-resolutionCoreference ResolutionEntity DisambiguationEntity Linking+1Qualitative and Quantitative Analysis of Diversity in Cross-document Coreference Resolution Datasets
Established cross-document coreference resolution (CDCR) datasets contain manually annotated event-centric mentions of events and entities that form coreference chains with identity relations. In this paper, we qualitati…
coreference-resolutionCoreference ResolutionCross Document Coreference ResolutionDiversityTowards Evaluation of Cross-document Coreference Resolution Models Using Datasets with Diverse Annotation Schemes
Established cross-document coreference resolution (CDCR) datasets contain event-centric coreference chains of events and entities with identity relations. These datasets establish strict definitions of the coreference re…
coreference-resolutionCoreference ResolutionCross Document Coreference ResolutionDiversityPARCO: Phoneme-Augmented Robust Contextual ASR via Contrastive Entity Disambiguation
Automatic speech recognition (ASR) systems struggle with domain-specific named entities, especially homophones. Contextual ASR improves recognition but often fails to capture fine-grained phoneme variations due to limite…
Entity DisambiguationSpeech RecognitionRevisiting Joint Modeling of Cross-document Entity and Event Coreference Resolution
Recognizing coreferring events and entities across multiple texts is crucial for many NLP applications. Despite the task's importance, research focus was given mostly to within-document entity coreference, with rather li…
coreference-resolutionCoreference ResolutionCross Document Coreference ResolutionEntity Cross-Document Coreference Resolution+3