paper-with-me

XWINO

홈페이지 · 논문 4편

XWINO is a multilingual collection of Winograd Schemas in six languages that can be used for evaluation of cross-lingual commonsense reasoning capabilities. The datasets that comprise XWINO are: * Source: The original Winograd Schema Challenge (Levesque, 2012); * Source: Additional data from the SuperGLUE WSC benchmark (Wang et al., 2019); * Source: The Definite Pronoun Resolution dataset (Rahman and Ng, 2012) (accessed from https://github.com/Yre/wsc_naive); * Source: A collection of French Winograd Schemas (Amsili and Seminck, 2017); * Source: Japanese translation of Winograd Schema Challenge (柴田知秀 et al., 2015); * Source: Russian Winograd Schema Challenge (Shavrina et al., 2020); * Source: A collection of Winograd Schemas in Chinese; * Source: Winograd Schemas in Portuguese (Melo et al., 2019).

Texts EnglishFrenchChineseJapaneseRussianPortuguese

벤치마크

Natural Language Inference on XWINO 결과 1개