A Study of Temporal Fusion Strategies for Named Entity Recognition in Historical Texts
Temporal variation poses a unique challenge for named entity recognition (NER) in historical texts, where entities drift in surface form and salience across time. While language models (LMs) have made progress in various NLP tasks, their ability to reason about temporality, especially in diachronic contexts, remains limited or at least, questionable. In this paper, we systematically study how temporal metadata can be structurally embedded into NER models using a range of lightweight fusion strategies. We experiment with both absolute and relative temporal representations, injected into Transformer-based architectures via early or late fusion mechanisms such as cross-attention, adapters, and concatenation. Our evaluations on French and German historical datasets reveal that late fusion strategies yield more robust and temporally generalisable performance, particularly in early and noisy periods.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Tracking the Diffusion of Named Entities
Existing studies of how information diffuses across social networks have thus far concentrated on analysing and recovering the spread of deterministic innovations such as URLs, hashtags, and group membership. However inv…
Entity Extraction using GANDiffusionNER: Boundary Diffusion for Named Entity Recognition
In this paper, we propose DiffusionNER, which formulates the named entity recognition task as a boundary-denoising diffusion process and thus generates named entities from noisy spans. During training, DiffusionNER gradu…
Chinese Named Entity RecognitionDenoisingnamed-entity-recognitionNamed Entity Recognition+3Explorers at #SMM4H 2023: Enhancing BERT for Health Applications through Knowledge and Model Fusion
An increasing number of individuals are willing to post states and opinions in social media, which has become a valuable data resource for studying human health. Furthermore, social media has been a crucial research poin…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERTransformer-based Named Entity Recognition with Combined Data Representation
This study examines transformer-based models and their effectiveness in named entity recognition tasks. The study investigates data representation strategies, including single, merged, and context, which respectively use…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)SentenceConstructing an Alias List for Named Entities during an Event
In certain fields, real-time knowledge from events can help in making informed decisions. In order to extract pertinent real-time knowledge related to an event, it is important to identify the named entities and their co…
Community Question AnsweringQuestion Answering