Named Entity Tagging a Very Large Unbalanced Corpus: Training and Evaluating NE Classifiers
We describe a systematic and application-oriented approach to training and evaluating named entity recognition and classification (NERC) systems, the purpose of which is to identify an optimal system and to train an optimal model for named entity tagging DeReKo, a very large general-purpose corpus of contemporary German (Kupietz et al., 2010). DeReKo {`}s strong dispersion wrt. genre, register and time forces us to base our decision for a specific NERC system on an evaluation performed on a representative sample of DeReKo instead of performance figures that have been reported for the individual NERC systems when evaluated on more uniform and less diverse data. We create and manually annotate such a representative sample as evaluation data for three different NERC systems, for each of which various models are learnt on multiple training data. The proposed sampling method can be viewed as a generally applicable method for sampling evaluation data from an unbalanced target corpus for any sort of natural language processing.
Code (0)
등록된 구현이 없습니다.
Tasks
ChunkingMachine Translationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Question AnsweringText ClassificationSimilar Papers 제목 키워드 기반
PAMPO: using pattern matching and pos-tagging for effective Named Entities recognition in Portuguese
This paper deals with the entity extraction task (named entity recognition) of a text mining process that aims at unveiling non-trivial semantic structures, such as relationships and interaction between entities or commu…
Entity Extraction using GANnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+4Czech Text Processing with Contextual Embeddings: POS Tagging, Lemmatization, Parsing and NER
Contextualized embeddings, which capture appropriate word meaning depending on context, have recently been proposed. We evaluate two meth ods for precomputing such embeddings, BERT and Flair, on four Czech text processin…
Dependency ParsingLemmatizationnamed-entity-recognitionNamed Entity Recognition+5Multifaceted Assessments of Traditional Chinese Word Segmentation Tool on Large Corpora
This study aims to evaluate three most popular word segmentation tool for a large Traditional Chinese corpus in terms of their efficiency, resource consumption, and cost. Specifically, we compare the performances of Jieb…
Chinese Word SegmentationGPUnamed-entity-recognitionNamed Entity Recognition+3Incorporating External Annotation to improve Named Entity Translation in NMT
The correct translation of named entities (NEs) still poses a challenge for conventional neural machine translation (NMT) systems. This study explores methods incorporating named entity recognition (NER) into NMT with th…
Machine Translationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+3A Unified Tagging Solution: Bidirectional LSTM Recurrent Neural Network with Word Embedding
Bidirectional Long Short-Term Memory Recurrent Neural Network (BLSTM-RNN) has been shown to be very effective for modeling and predicting sequential data, e.g. speech utterances or handwritten documents. In this study, w…
ChunkingFeature Engineeringnamed-entity-recognitionNamed Entity Recognition+2