Multimodal Reasoning 벤치마크
Multimodal Reasoning on MATH-V
Accuracy
- 2024-02-22 — GPT4V: Accuracy 22.76
| Rank | Model | Accuracy | Extra Training Data | Paper | Code | Year |
|---|---|---|---|---|---|---|
| 1 | GPT4V | 22.76 | ✓ | Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset | mathllm/math-v | 2024 |
| 2 | Gemini Pro | 17.66 | ✓ | Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset | mathllm/math-v | 2024 |
| 3 | Qwen-VL-Max | 15.59 | ✓ | Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset | mathllm/math-v | 2024 |
| 4 | InternLM-XComposer2-VL | 14.54 | ✓ | Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset | mathllm/math-v | 2024 |