Zero-shot Slot Filling on MASSIVE
Slot F1 Score
- 2022-04-18 — XLM-R Base: Slot F1 Score 64.2
| Rank | Model | Slot F1 Score | Paper | Code | Year |
|---|---|---|---|---|---|
| 1 | XLM-R Base | 64.2 | MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languages | alexa/massive · pswietojanski/slurp · ai4bharat/indicbert · +3 | 2022 |
| 2 | mT5 Base (encoder-only) | 56.9 | MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languages | alexa/massive · pswietojanski/slurp · ai4bharat/indicbert · +3 | 2022 |
| 3 | mT5 Base (text-to-text) | 50.6 | MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languages | alexa/massive · pswietojanski/slurp · ai4bharat/indicbert · +3 | 2022 |