Multiple Choice Question Answering (MCQA) 벤치마크
Multiple Choice Question Answering (MCQA) on MMLU (Anatomy)
Accuracy
- 2023-05-16 — Med-PaLM 2 (ER): Accuracy 84.4
| Rank | Model | Accuracy | Paper | Code | Year |
|---|---|---|---|---|---|
| 1 | Med-PaLM 2 (ER) | 84.4 | Towards Expert-Level Medical Question Answering with Large Language Models | m42-health/med42 | 2023 |
| 2 | Med-PaLM 2 (CoT + SC) | 80.0 | Towards Expert-Level Medical Question Answering with Large Language Models | m42-health/med42 | 2023 |
| 3 | Med-PaLM 2 (5-shot) | 77.8 | Towards Expert-Level Medical Question Answering with Large Language Models | m42-health/med42 | 2023 |