Multilinguals at SemEval-2022 Task 11: Complex NER in Semantically Ambiguous Settings for Low Resource Languages
We leverage pre-trained language models to solve the task of complex NER for two low-resource languages: Chinese and Spanish. We use the technique of Whole Word Masking(WWM) to boost the performance of masked language modeling objective on large and unsupervised corpora. We experiment with multiple neural network architectures, incorporating CRF, BiLSTMs, and Linear Classifiers on top of a fine-tuned BERT layer. All our models outperform the baseline by a significant margin and our best performing model obtains a competitive position on the evaluation leaderboard for the blind test set.
Code (1)
Tasks
Language ModelingLanguage ModellingMasked Language ModelingNERPositionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Multilinguals at SemEval-2022 Task 11: Transformer Based Architecture for Complex NER
We investigate the task of complex NER for the English language. The task is non-trivial due to the semantic ambiguity of the textual structure and the rarity of occurrence of such entities in the prevalent literature. U…
NERCASIA at SemEval-2022 Task 11: Chinese Named Entity Recognition for Complex and Ambiguous Entities
This paper describes our approach to develop a complex named entity recognition system in SemEval 2022 Task 11: MultiCoNER Multilingual Complex Named Entity Recognition,Track 9 - Chinese. In this task, we need to identif…
Chinese Named Entity RecognitionData AugmentationDomain Adaptationnamed-entity-recognition+2CMB AI Lab at SemEval-2022 Task 11: A Two-Stage Approach for Complex Named Entity Recognition via Span Boundary Detection and Span Classification
This paper presents a solution for the SemEval-2022 Task 11 Multilingual Complex Named Entity Recognition. What is challenging in this task is detecting semantically ambiguous and complex entities in short and low-contex…
Boundary Detectionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)MarSan at SemEval-2022 Task 11: Multilingual complex named entity recognition using T5 and transformer encoder
The multilingual complex named entity recognition task of SemEval2020 required participants to detect semantically ambiguous and complex entities in 11 languages. In order to participate in this competition, a deep learn…
Language ModelingLanguage Modellingnamed-entity-recognitionNamed Entity Recognition+1DAMO-NLP at SemEval-2022 Task 11: A Knowledge-based System for Multilingual Named Entity Recognition
The MultiCoNER shared task aims at detecting semantically ambiguous and complex named entities in short and low-context settings for multiple languages. The lack of contexts makes the recognition of ambiguous named entit…
Multilingual Named Entity RecognitionNamed Entity RecognitionNamed Entity Recognition (NER)Sentence