Question Answering 벤치마크
Question Answering on RuOpenBookQA
Accuracy
- 2022-10-23 — Human benchmark: Accuracy 86.5
| Rank | Model | Accuracy | Paper | Code | Year |
|---|---|---|---|---|---|
| 1 | Human benchmark | 86.5 | TAPE: Assessing Few-shot Russian Language Understanding | RussianNLP/TAPE | 2022 |
| 2 | RuGPT-3 Small | 57.9 | TAPE: Assessing Few-shot Russian Language Understanding | RussianNLP/TAPE | 2022 |
| 3 | RuGPT-3 Medium | 57.2 | TAPE: Assessing Few-shot Russian Language Understanding | RussianNLP/TAPE | 2022 |
| 4 | RuGPT-3 Large | 55.5 | TAPE: Assessing Few-shot Russian Language Understanding | RussianNLP/TAPE | 2022 |