Fine Tuning Named Entity Extraction Models for the Fantasy Domain
Named Entity Recognition (NER) is a sequence classification Natural Language Processing task where entities are identified in the text and classified into predefined categories. It acts as a foundation for most information extraction systems. Dungeons and Dragons (D&D) is an open-ended tabletop fantasy game with its own diverse lore. DnD entities are domain-specific and are thus unrecognizable by even the state-of-the-art off-the-shelf NER systems as the NER systems are trained on general data for pre-defined categories such as: person (PERS), location (LOC), organization (ORG), and miscellaneous (MISC). For meaningful extraction of information from fantasy text, the entities need to be classified into domain-specific entity categories as well as the models be fine-tuned on a domain-relevant corpus. This work uses available lore of monsters in the D&D domain to fine-tune Trankit, which is a prolific NER framework that uses a pre-trained model for NER. Upon this training, the system acquires the ability to extract monster names from relevant domain documents under a novel NER tag. This work compares the accuracy of the monster name identification against; the zero-shot Trankit model and two FLAIR models. The fine-tuned Trankit model achieves an 87.86% F1 score surpassing all the other considered models.
Code (0)
등록된 구현이 없습니다.
Tasks
Miscellaneousnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERTAGSimilar Papers 제목 키워드 기반
Comparative Analysis of Named Entity Recognition in the Dungeons and Dragons Domain
Many NLP tasks, although well-resolved for general English, face challenges in specific domains like fantasy literature. This is evident in Named Entity Recognition (NER), which detects and categorizes entities in text. …
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERDistantly supervised end-to-end medical entity extraction from electronic health records with human-level quality
Medical entity extraction (EE) is a standard procedure used as a first stage in medical texts processing. Usually Medical EE is a two-step process: named entity recognition (NER) and named entity normalization (NEN). We …
Multi-Label ClassificationMUlTI-LABEL-ClASSIFICATIONnamed-entity-recognitionNamed Entity Recognition+2The impact of fine tuning in LLaMA on hallucinations for named entity extraction in legal documentation
The extraction of information about traffic accidents from legal documents is crucial for quantifying insurance company costs. Extracting entities such as percentages of physical and/or psychological disability and the i…
Text SegmentationFRE at SocialDisNER: Joint Learning of Language Models for Named Entity Recognition
This paper describes our followed methodology for the automatic extraction of disease mentions from tweets in Spanish as part of the SocialDisNER challenge within the 2022 Social Media Mining for Health Applications (SMM…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Text GenerationClinical Trial Information Extraction with BERT
Natural language processing (NLP) of clinical trial documents can be useful in new trial design. Here we identify entity types relevant to clinical trial design and propose a framework called CT-BERT for information extr…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER