Adversarial Adaptation for French Named Entity Recognition
Named Entity Recognition (NER) is the task of identifying and classifying named entities in large-scale texts into predefined classes. NER in French and other relatively limited-resource languages cannot always benefit from approaches proposed for languages like English due to a dearth of large, robust datasets. In this paper, we present our work that aims to mitigate the effects of this dearth of large, labeled datasets. We propose a Transformer-based NER approach for French, using adversarial adaptation to similar domain or general corpora to improve feature extraction and enable better generalization. Our approach allows learning better features using large-scale unlabeled corpora from the same domain or mixed domains to introduce more variations during training and reduce overfitting. Experimental results on three labeled datasets show that our adaptation framework outperforms the corresponding non-adaptive models for various combinations of Transformer models, source datasets, and target corpora. We also show that adversarial adaptation to large-scale unlabeled corpora can help mitigate the performance dip incurred on using Transformer models pre-trained on smaller corpora.
Code (1)
Tasks
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Transformer-Based Named Entity Recognition for French Using Adversarial Adaptation to Similar Domain Corpora
Named Entity Recognition (NER) involves the identification and classification of named entities in unstructured text into predefined classes. NER in languages with limited resources, like French, is still an open problem…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERAdaptation d'un syst\`eme de reconnaissance d'entit\'es nomm\'ees pour le fran\ccais \`a l'anglais \`a moindre co\^ut (Adapting a French Named Entity Recognition System to English with Minimal Costs) [in French]
Rep\'erage des entit\'es nomm\'ees pour l'arabe : adaptation non-supervis\'ee et combinaison de syst\`emes (Named Entity Recognition for Arabic : Unsupervised adaptation and Systems combination) [in French]
A Data-driven Approach to Named Entity Recognition for Early Modern French
Named entity recognition has become an increasingly useful tool for digital humanities research, specially when it comes to historical texts. However, historical texts pose a wide range of challenges to both named entity…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERA Benchmark Evaluation of Clinical Named Entity Recognition in French
Background: Transformer-based language models have shown strong performance on many Natural LanguageProcessing (NLP) tasks. Masked Language Models (MLMs) attract sustained interest because they can be adaptedto different…
named-entity-recognitionNamed Entity Recognition