MultiCoNER v2: a Large Multilingual dataset for Fine-grained and Noisy Named Entity Recognition

2023-10-20 · Besnik Fetahu, Zhiyu Chen, Sudipta Kar, Oleg Rokhlenko, Shervin Malmasi

We present MULTICONER V2, a dataset for fine-grained Named Entity Recognition covering 33 entity classes across 12 languages, in both monolingual and multilingual settings. This dataset aims to tackle the following practical challenges in NER: (i) effective handling of fine-grained classes that include complex entities like movie titles, and (ii) performance degradation due to noise generated from typing mistakes or OCR errors. The dataset is compiled from open resources like Wikipedia and Wikidata, and is publicly available. Evaluation based on the XLM-RoBERTa baseline highlights the unique challenges posed by MULTICONER V2: (i) the fine-grained taxonomy is challenging, where the scores are low with macro-F1=0.63 (across all languages), and (ii) the corruption strategy significantly impairs performance, with entity corruption resulting in 9% lower performance relative to non-entity corruptions across all languages. This highlights the greater impact of entity noise in contrast to context noise.

📄 PDF Abstract BibTeX arXiv:2310.13213

Code (0)

등록된 구현이 없습니다.

Tasks

named-entity-recognitionNamed Entity RecognitionNER Optical Character Recognition (OCR)

SemEval-2023 Task 2: Fine-grained Multilingual Named Entity Recognition (MultiCoNER 2)

2023-05-11 · Besnik Fetahu, Sudipta Kar, Zhiyu Chen, Oleg Rokhlenko 외

We present the findings of SemEval-2023 Task 2 on Fine-grained Multilingual Named Entity Recognition (MultiCoNER 2). Divided into 13 tracks, the task focused on methods to identify complex fine-grained named entities (li…

Multilingual Named Entity Recognition named-entity-recognition Named Entity Recognition NER+1

DAMO-NLP at SemEval-2023 Task 2: A Unified Retrieval-augmented System for Multilingual Named Entity Recognition

2023-05-05 · Zeqi Tan, Shen Huang, Zixia Jia, Jiong Cai 외

The MultiCoNER \RNum{2} shared task aims to tackle multilingual named entity recognition (NER) in fine-grained and noisy scenarios, and it inherits the semantic ambiguity and low-context setting of the MultiCoNER \RNum{1…

Multilingual Named Entity Recognition named-entity-recognition Named Entity Recognition Named Entity Recognition (NER)+3

MultiCoNER: A Large-scale Multilingual dataset for Complex Named Entity Recognition

2022-08-30 · COLING 2022 10 · Shervin Malmasi, Anjie Fang, Besnik Fetahu, Sudipta Kar 외

We present MultiCoNER, a large multilingual dataset for Named Entity Recognition that covers 3 domains (Wiki sentences, questions, and search queries) across 11 languages, as well as multilingual and code-mixing subsets.…

Machine Translation named-entity-recognition Named Entity Recognition Named Entity Recognition (NER)+2

SemEval-2022 Task 11: Multilingual Complex Named Entity Recognition (MultiCoNER)

2022-07-01 · SemEval (NAACL) 2022 7 · Shervin Malmasi, Anjie Fang, Besnik Fetahu, Sudipta Kar 외

We present the findings of SemEval-2022 Task 11 on Multilingual Complex Named Entity Recognition MULTICONER. Divided into 13 tracks, the task focused on methods to identify complex named entities (like names of movies, p…

named-entity-recognition Named Entity Recognition Named Entity Recognition (NER)NER

UM6P-CS at SemEval-2022 Task 11: Enhancing Multilingual and Code-Mixed Complex Named Entity Recognition via Pseudo Labels using Multilingual Transformer

2022-04-28 · SemEval (NAACL) 2022 7 · Abdellah El Mekki, Abdelkader El Mahdaouy, Mohammed Akallouch, Ismail Berrada 외

Building real-world complex Named Entity Recognition (NER) systems is a challenging task. This is due to the complexity and ambiguity of named entities that appear in various contexts such as short input sentences, emerg…

named-entity-recognition Named Entity Recognition Named Entity Recognition (NER)NER+2