paper-with-me

LiDiRus

Linguistic Diagnostic for Russian

홈페이지 · 논문 5편

LiDiRus is a diagnostic dataset that covers a large volume of linguistic phenomena, while allowing you to evaluate information systems on a simple test of textual entailment recognition. See more details diagnostics. ### Task Type RTE (Recognizing Textual Entailment) Sentence Pair Classification - Entailment - Not Entailment ### Example `` { 'sentence1': "Кошка сидела на коврике.", 'sentence2': "Кошка не сидела на коврике.", 'label': 'not_entailment', 'knowledge': '', 'lexical-semantics': '', 'logic': 'Negation', 'predicate-argument-structure': '' } `` ### How did we collect data? All text examples manually translated and adapted from English SuperGLUE Diagnostics

Texts Russian

벤치마크

Natural Language Inference on LiDiRus 결과 22개