paper-with-me

SberQuAD

Sberbank Question Answering Dataset

홈페이지 · 논문 10편

A large scale analogue of Stanford SQuAD in the Russian language - is a valuable resource that has not been properly presented to the scientific community. Source: [SberQuAD -- Russian Reading Comprehension Dataset: Description and Analysis](/paper/sberquad-russian-reading-comprehension) See DeepPavlov link ### Model results | Model config | EM (dev) | F-1 (dev) | |------------------------------|-------------|-------------| |DeepPavlov RuBERT | 66.30+-0.24 | 84.60+-0.11 | | DeepPavlov multilingual BERT | 64.35+-0.39 | 83.39+-0.08 | | DeepPavlov R-Net | 60.62 | 80.04 |

Russian

벤치마크

Question Answering on SberQuAD 결과 3개