paper-with-me

Papers

Enhanced Meta-Learning for Cross-lingual Named Entity Recognition with Minimal Resources

2019-11-14 · Qianhui Wu, Zijia Lin, Guoxin Wang, Hui Chen, Börje F. Karlsson, Biqing Huang, Chin-Yew Lin

For languages with no annotated resources, transferring knowledge from rich-resource languages is an effective solution for named entity recognition (NER). While all existing methods directly transfer from source-learned model to a target language, in this paper, we propose to fine-tune the learned model with a few similar examples given a test case, which could benefit the prediction by leveraging the structural and semantic information conveyed in such similar examples. To this end, we present a meta-learning algorithm to find a good model parameter initialization that could fast adapt to the given test case and propose to construct multiple pseudo-NER tasks for meta-training by computing sentence similarities. To further improve the model's generalization ability across different languages, we introduce a masking scheme and augment the loss function with an additional maximum term during meta-training. We conduct extensive experiments on cross-lingual named entity recognition with minimal resources over five target languages. The results show that our approach significantly outperforms existing state-of-the-art methods across the board.

📄 PDF Abstract BibTeX arXiv:1911.06161

Code (1)

microsoft/vert-papers/tree/master/papers/Meta-Cross 공식 구현 pytorch

Tasks

Cross-Lingual NERCross-Lingual TransferMeta-Learningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERSentence

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Learning Multilingual Meta-Embeddings for Code-Switching Named Entity Recognition

2019-08-01 · WS 2019 8 · Genta Indra Winata, Zhaojiang Lin, Pascale Fung

In this paper, we propose Multilingual Meta-Embeddings (MME), an effective method to learn multilingual representations by leveraging monolingual pre-trained embeddings. MME learns to utilize information from these embed…

Language IdentificationMMEnamed-entity-recognitionNamed Entity Recognition+1

Multilingual Named Entity Recognition using Parallel Data and Metadata from Wikipedia

2012-07-01 · ACL 2012 7 · Sungchul Kim, Kristina Toutanova, Hwanjo Yu
Multilingual Named Entity Recognitionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)

Type-enhanced Ensemble Triple Representation via Triple-aware Attention for Cross-lingual Entity Alignment

2023-05-02 · Zhishuo Zhang, Chengxiang Tan, Haihang Wang, Xueyan Zhao 외

Entity alignment(EA) is a crucial task for integrating cross-lingual and cross-domain knowledge graphs(KGs), which aims to discover entities referring to the same real-world object from different KGs. Most existing metho…

DiversityEntity AlignmentKnowledge GraphsSpecificity

MetaXL: Meta Representation Transformation for Low-resource Cross-lingual Learning

2021-04-16 · NAACL 2021 4 · Mengzhou Xia, Guoqing Zheng, Subhabrata Mukherjee, Milad Shokouhi 외

The combination of multilingual pre-trained representations and cross-lingual transfer learning is one of the most effective methods for building functional NLP systems for low-resource languages. However, for extremely …

Cross-Lingual TransferMeta-Learningnamed-entity-recognitionNamed Entity Recognition+3

Hierarchical Meta-Embeddings for Code-Switching Named Entity Recognition

2019-09-18 · IJCNLP 2019 11 · Genta Indra Winata, Zhaojiang Lin, Jamin Shin, Zihan Liu 외

In countries that speak multiple main languages, mixing up different languages within a conversation is commonly called code-switching. Previous works addressing this challenge mainly focused on word-level aspects such a…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Word Embeddings