Intent Recognition 벤치마크
Intent Recognition on BIG-bench
Accuracy
- 2021-12-08 — Gopher-280B (few-shot, k=5): Accuracy 88.7
- 2022-03-29 — Chinchilla-70B (few-shot, k=5): Accuracy 92.8
| Rank | Model | Accuracy | Paper | Code | Year |
|---|---|---|---|---|---|
| 1 | Chinchilla-70B (few-shot, k=5) | 92.8 | Training Compute-Optimal Large Language Models | karpathy/llama2.c · nkluge-correa/teenytinyllama | 2022 |
| 2 | Gopher-280B (few-shot, k=5) | 88.7 | Scaling Language Models: Methods, Analysis & Insights from Training Gopher | allenai/dolma · rvlopes/gloria · bramiozo/PubScience | 2021 |
| 3 | Chinchilla-70B (few-shot, k=5) | 92.8 | Training Compute-Optimal Large Language Models | karpathy/llama2.c · nkluge-correa/teenytinyllama | 2022 |
| 4 | Gopher-280B (few-shot, k=5) | 88.7 | Scaling Language Models: Methods, Analysis & Insights from Training Gopher | allenai/dolma · rvlopes/gloria · bramiozo/PubScience | 2021 |