Entity Projection via Machine Translation for Cross-Lingual NER
Although over 100 languages are supported by strong off-the-shelf machine translation systems, only a subset of them possess large annotated corpora for named entity recognition. Motivated by this fact, we leverage machine translation to improve annotation-projection approaches to cross-lingual named entity recognition. We propose a system that improves over prior entity-projection methods by: (a) leveraging machine translation systems twice: first for translating sentences and subsequently for translating entities; (b) matching entities based on orthographic and phonetic similarity; and (c) identifying matches based on distributional statistics derived from the dataset. Our approach improves upon current state-of-the-art methods for cross-lingual named entity recognition on 5 diverse languages by an average of 4.1 points. Further, our method achieves state-of-the-art F_1 scores for Armenian, outperforming even a monolingual model trained on Armenian source data.
Code (1)
Tasks
Cross-Lingual NERMachine Translationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERTranslationSimilar Papers 제목 키워드 기반
CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation
Named entity recognition (NER) suffers from the scarcity of annotated training data, especially for low-resource languages without labeled data. Cross-lingual NER has been proposed to alleviate this issue by transferring…
Cross-Lingual NERMachine Translationnamed-entity-recognitionNamed Entity Recognition+4Contextual Label Projection for Cross-Lingual Structured Prediction
Label projection, which involves obtaining translated labels and texts jointly, is essential for leveraging machine translation to facilitate cross-lingual transfer in structured prediction tasks. Prior research explorin…
Cross-Lingual TransferEvent Argument ExtractionMachine Translationnamed-entity-recognition+7Revisiting Projection-based Data Transfer for Cross-Lingual Named Entity Recognition in Low-Resource Languages
Cross-lingual Named Entity Recognition (NER) leverages knowledge transfer between languages to identify and classify named entities, making it particularly useful for low-resource languages. We show that the data-based c…
Cross-Lingual NERCross-Lingual Transfernamed-entity-recognitionNamed Entity Recognition+3Cross-lingual Entity Alignment via Joint Attribute-Preserving Embedding
Entity alignment is the task of finding entities in two knowledge bases (KBs) that represent the same real-world object. When facing KBs in different natural languages, conventional cross-lingual entity alignment methods…
AttributeEntity AlignmentMachine TranslationTranslationCross-Lingual Named Entity Recognition via FastAlign: a Case Study
Named Entity Recognition is an essential task in natural language processing to detect entities and classify them into predetermined categories. An entity is a meaningful word, or phrase that refers to proper nouns. Name…
Machine Translationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+4