paper-with-me

홈 › Papers

Adversarial Adaptation for French Named Entity Recognition

2023-01-12 · Arjun Choudhry, Inder Khatri, Pankaj Gupta, Aaryan Gupta, Maxime Nicol, Marie-Jean Meurs, Dinesh Kumar Vishwakarma

Named Entity Recognition (NER) is the task of identifying and classifying named entities in large-scale texts into predefined classes. NER in French and other relatively limited-resource languages cannot always benefit from approaches proposed for languages like English due to a dearth of large, robust datasets. In this paper, we present our work that aims to mitigate the effects of this dearth of large, labeled datasets. We propose a Transformer-based NER approach for French, using adversarial adaptation to similar domain or general corpora to improve feature extraction and enable better generalization. Our approach allows learning better features using large-scale unlabeled corpora from the same domain or mixed domains to introduce more variations during training and reduce overfitting. Experimental results on three labeled datasets show that our adaptation framework outperforms the corresponding non-adaptive models for various combinations of Transformer models, source datasets, and target corpora. We also show that adversarial adaptation to large-scale unlabeled corpora can help mitigate the performance dip incurred on using Transformer models pre-trained on smaller corpora.

📄 PDF Abstract BibTeX arXiv:2301.05220

Code (1)

arjun7m/aa_ner_fr 공식 구현 pytorch

Tasks

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Transformer-Based Named Entity Recognition for French Using Adversarial Adaptation to Similar Domain Corpora

2022-12-05 · Arjun Choudhry, Pankaj Gupta, Inder Khatri, Aaryan Gupta 외

Named Entity Recognition (NER) involves the identification and classification of named entities in unstructured text into predefined classes. NER in languages with limited resources, like French, is still an open problem…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER

Adaptation d'un syst\`eme de reconnaissance d'entit\'es nomm\'ees pour le fran\ccais \`a l'anglais \`a moindre co\^ut (Adapting a French Named Entity Recognition System to English with Minimal Costs) [in French]

2012-06-01 · JEPTALNRECITAL 2012 6 · Mohamed Hatmi
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)

Rep\'erage des entit\'es nomm\'ees pour l'arabe : adaptation non-supervis\'ee et combinaison de syst\`emes (Named Entity Recognition for Arabic : Unsupervised adaptation and Systems combination) [in French]

2012-06-01 · JEPTALNRECITAL 2012 6 · Souhir Gahbiche-Braham, H{\'e}l{\`e}ne Bonneau-Maynard, Thomas Lavergne, Fran{\c{c}}ois Yvon
Domain AdaptationFeature EngineeringMachine Translationnamed-entity-recognition+3

A Data-driven Approach to Named Entity Recognition for Early Modern French

2022-10-01 · COLING 2022 10 · Pedro Ortiz Suarez, Simon Gabay

Named entity recognition has become an increasingly useful tool for digital humanities research, specially when it comes to historical texts. However, historical texts pose a wide range of challenges to both named entity…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER

A Benchmark Evaluation of Clinical Named Entity Recognition in French

2024-03-28 · Nesrine Bannour, Christophe Servan, Aurélie Névéol, Xavier Tannier

Background: Transformer-based language models have shown strong performance on many Natural LanguageProcessing (NLP) tasks. Masked Language Models (MLMs) attract sustained interest because they can be adaptedto different…

named-entity-recognitionNamed Entity Recognition