Transfer-based Enrichment of a Hungarian Named Entity Dataset
In this paper, we present a major update to the first Hungarian named entity dataset, the Szeged NER corpus. We used zero-shot cross-lingual transfer to initialize the enrichment of entity types annotated in the corpus using three neural NER models: two of them based on the English OntoNotes corpus and one based on the Czech Named Entity Corpus finetuned from multilingual neural language models. The output of the models was automatically merged with the original NER annotation, and automatically and manually corrected and further enriched with additional annotation, like qualifiers for various entity types. We present the evaluation of the zero-shot performance of the two OntoNotes-based models and a transformer-based new NER model trained on the training part of the final corpus. We release the corpus and the trained model.
Code (0)
등록된 구현이 없습니다.
Tasks
Cross-Lingual TransferNERZero-Shot Cross-Lingual TransferSimilar Papers 제목 키워드 기반
NerKor+Cars-OntoNotes++
In this paper, we present an upgraded version of the Hungarian NYTK-NerKor named entity corpus, which contains about twice as many annotated spans and 7 times as many distinct entity types as the original version. We use…
Cross-Lingual TransferNERNeural Relation Extraction for Knowledge Base Enrichment
We study relation extraction for knowledge base (KB) enrichment. Specifically, we aim to extract entities and their relationships from sentences in the form of triples and map the elements of the extracted triples to an …
DecoderEntity DisambiguationEntity EmbeddingsRelation+2DeviceBERT: Applied Transfer Learning With Targeted Annotations and Vocabulary Enrichment to Identify Medical Device and Component Terminology in FDA Recall Summaries
FDA Medical Device recalls are critical and time-sensitive events, requiring swift identification of impacted devices to inform the public of a recall event and ensure patient safety. The OpenFDA device recall dataset co…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+1Media monitoring and information extraction for the highly inflected agglutinative language Hungarian
The Europe Media Monitor (EMM) is a fully-automatic system that analyses written online news by gathering articles in over 70 languages and by applying text analysis software for currently 21 languages, without using lin…
ArticlesInformation Retrievalnamed-entity-recognitionNamed Entity Recognition+1The hunvec framework for NN-CRF-based sequential tagging
In this work we present the open source hunvec framework for sequential tagging, built upon Theano and Pylearn2. The underlying statistical model, which connects linear CRF-s with neural networks, was used by Collobert a…
Feature Engineeringnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)