Mathematical Reasoning on FrontierMath
| Rank | Model | Accuracy | Paper | Code | Year |
|---|---|---|---|---|---|
| 1 | o3 | 0.252 | |||
| 2 | Gemini 1.5 Pro (002) | 0.02 | FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI | 2024 | |
| 3 | Claude 3.5 Sonnet | 0.01 | |||
| 3 | o1-preview | 0.01 | |||
| 3 | o1-mini | 0.01 | |||
| 3 | GPT-4o | 0.01 |