WikiANN
홈페이지 · 논문 72편
WikiANN, also known as PAN-X, is a multilingual named entity recognition dataset. It consists of Wikipedia articles that have been annotated with LOC (location), PER (person), and ORG (organization) tags in the IOB2 format¹². This dataset serves as a valuable resource for training and evaluating named entity recognition models across various languages. For instance, it includes information about notable individuals, places, and organizations mentioned in Wikipedia articles. Researchers and practitioners can use WikiANN to develop and improve natural language processing systems that identify and classify named entities in text. (1) wikiann · Datasets at Hugging Face. https://huggingface.co/datasets/wikiann. (2) wikiann | TensorFlow Datasets. https://tensorflow.google.cn/datasets/catalog/wikiann. (3) wikiann · Datasets at Hugging Face. https://huggingface.co/datasets/wikiann/viewer/en. (4) WikiAnn Dataset | Papers With Code. https://paperswithcode.com/dataset/wikiann-1.
EnglishFrenchSpanishGermanItalianChineseBengaliMultilingualJapaneseRussianPortugueseAfrikaansAlbanianAmharicArabicArmenianBambaraBasqueBelarusianBretonBulgarianCatalanChurch SlavicCroatianCzechDanishDutchErzyaEstonianFaroeseFinnishGalicianGothicHebrewHindiHungarianIcelandicIndonesianIrishKazakhKomi-PermyakKoreanLatinLatvianLithuanianLivviMalteseManxMarathiMokshaNorthern SamiNorwegianPersianPolishRomanianRussia BuriatSanskritScottish GaelicSerbianSlovakSlovenianSwedishTagalogTamilTeluguThaiTurkishUighurUkrainianUpper SorbianUrduVietnameseWelshWolofYorubaAfarAbkhazianAchineseAdygheAkanTosk AlbanianOld English (ca. 450-1100)Official Aramaic (700-300 BCE)AragoneseEgyptian ArabicAssameseAsturianAvaricAymaraSouth AzerbaijaniAzerbaijaniBashkirBavarianCentral BikolBislamaBanjarTibetanBosnianBishnupriyaBugineseMin Dong ChineseCebuanoChamorroChechenChoctawCherokeeChuvashCheyenneCentral KurdishCornishCorsicanCreeCrimean TatarKashubianDimli (individual language)DhivehiLower SorbianDzongkhaModern Greek (1453-)EsperantoEweExtremaduranFijianArpitanNorthern FrisianWestern FrisianFulahFriulianGagauzGan ChineseGilakiGoan KonkaniGuaraniGujaratiHakka ChineseHaitianHausaHawaiianSerbo-CroatianHereroFiji HindiHiri MotuIgboIdoSichuan YiInuktitutInterlingueIlokoInterlingua (International Auxiliary Language Association)InupiaqJamaican Creole EnglishJavaneseLojbanKara-KalpakKabyleKalaallisutKannadaKashmiriGeorgianKanuriKabardianCentral KhmerKikuyuKinyarwandaKirghizKomiKongoKarachay-BalkarKölschKuanyamaKurdishLadinoLaoLakLezghianLigurianLimburganLingalaLombardNorthern LuriLatgalianLuxembourgishGandaMarshalleseMaithiliMalayalamEastern MariMinangkabauMacedonianMalagasyMongolianMaoriWestern MariMalay (macrolanguage)CreekMirandeseBurmeseMazanderaniNeapolitanNauruNavajoNdongaLow GermanNepali (macrolanguage)NewariNorwegian NynorskNovialNaromPediNyanjaOccitan (post 1500)Oriya (macrolanguage)OromoOssetianPangasinanPampangaPapiamentoPicardPennsylvania GermanPfaelzischPitcairn-NorfolkPaliPiemonteseWestern PanjabiPonticPushtoQuechuaVlax RomaniRomanshRusynRundiSangoYakutSicilianScotsSinhalaSamoanShonaSindhiSomaliSouthern SothoSardinianSranan TongoSwatiSaterfriesischSundaneseSwahili (macrolanguage)SilesianTahitianTatarTuluTetumTajikTigrinyaTonga (Tonga Islands)Tok PisinTswanaTsongaTurkmenTumbukaTwiTuvinianUdmurtUzbekVenetianVendaVepsVlaamsVolapükWaray (Philippines)WalloonWu ChineseKalmykXhosaMingrelianYiddishZeeuwsZhuangZulu