paper-with-me

Math Word Problem Solving 벤치마크

Math Word Problem Solving on ASDiv-A

36개 결과 · ⬇ CSV · JSON

Execution Accuracy

76.9 80.43 83.95 87.47 91 2021-03 2026-11 Graph2Tree with RoBERTa — 82.2 (2021-03-12) GTS with RoBERTa — 81.2 (2021-03-12) LSTM Seq2Seq with RoBERTa — 76.9 (2021-03-12) Graph2Tree with RoBERTa — 82.2 (2021-03-12) GTS with RoBERTa — 81.2 (2021-03-12) LSTM Seq2Seq with RoBERTa — 76.9 (2021-03-12) Graph2Tree with RoBERTa — 82.2 (2021-03-12) GTS with RoBERTa — 81.2 (2021-03-12) LSTM Seq2Seq with RoBERTa — 76.9 (2021-03-12) Graph2Tree with RoBERTa — 82.2 (2021-03-12) GTS with RoBERTa — 81.2 (2021-03-12) LSTM Seq2Seq with RoBERTa — 76.9 (2021-03-12) ATHENA (roberta-large) — 91.0 (2023-11-02) ATHENA (roberta-base) — 86.4 (2023-11-02) ATHENA (roberta-large) — 91.0 (2023-11-02) ATHENA (roberta-base) — 86.4 (2023-11-02) ATHENA (roberta-large) — 91.0 (2023-11-02) ATHENA (roberta-base) — 86.4 (2023-11-02) ATHENA (roberta-large) — 91.0 (2023-11-02) ATHENA (roberta-base) — 86.4 (2023-11-02) OpenMath-CodeLlama-70B (w/ code) — 84.7 (2024-02-15) OpenMath-CodeLlama-70B (w/ code) — 84.7 (2024-02-15) OpenMath-CodeLlama-70B (w/ code) — 84.7 (2024-02-15) OpenMath-CodeLlama-70B (w/ code) — 84.7 (2024-02-15) MMOS-DeepSeekMath-7B(0-shot) — 87.6 (2024-02-23) MMOS-CODE-34B(0-shot) — 85.1 (2024-02-23) MMOS-CODE-7B(0-shot) — 78.6 (2024-02-23) MMOS-DeepSeekMath-7B(0-shot) — 87.6 (2024-02-23) MMOS-CODE-34B(0-shot) — 85.1 (2024-02-23) MMOS-CODE-7B(0-shot) — 78.6 (2024-02-23) MMOS-DeepSeekMath-7B(0-shot) — 87.6 (2024-02-23) MMOS-CODE-34B(0-shot) — 85.1 (2024-02-23) MMOS-CODE-7B(0-shot) — 78.6 (2024-02-23) MMOS-DeepSeekMath-7B(0-shot) — 87.6 (2024-02-23) MMOS-CODE-34B(0-shot) — 85.1 (2024-02-23) MMOS-CODE-7B(0-shot) — 78.6 (2024-02-23) Graph2Tree with RoBERTa — 82.2 (2021-03-12) ATHENA (roberta-large) — 91.0 (2023-11-02)
RankModel Execution Accuracy Extra Training Data PaperCodeYear
1 ATHENA (roberta-large) 91 ATHENA: Mathematical Reasoning with Thought Expansion the-jb/athena-math 2023
2 MMOS-DeepSeekMath-7B(0-shot) 87.6 ✓ An Empirical Study of Data Ability Boundary in LLMs' Math Reasoning cyzhh/MMOS 2024
3 ATHENA (roberta-base) 86.4 ATHENA: Mathematical Reasoning with Thought Expansion the-jb/athena-math 2023
4 MMOS-CODE-34B(0-shot) 85.1 ✓ An Empirical Study of Data Ability Boundary in LLMs' Math Reasoning cyzhh/MMOS 2024
5 OpenMath-CodeLlama-70B (w/ code) 84.7 ✓ OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset kipok/nemo-skills 2024
6 Graph2Tree with RoBERTa 82.2 Are NLP Models really able to Solve Simple Math Word Problems? arkilpatel/SVAMP · debjitpaul/refiner · vedantgaur/symbolic-mwp-reasoning 2021
7 GTS with RoBERTa 81.2 Are NLP Models really able to Solve Simple Math Word Problems? arkilpatel/SVAMP · debjitpaul/refiner · vedantgaur/symbolic-mwp-reasoning 2021
8 MMOS-CODE-7B(0-shot) 78.6 ✓ An Empirical Study of Data Ability Boundary in LLMs' Math Reasoning cyzhh/MMOS 2024
9 LSTM Seq2Seq with RoBERTa 76.9 Are NLP Models really able to Solve Simple Math Word Problems? arkilpatel/SVAMP · debjitpaul/refiner · vedantgaur/symbolic-mwp-reasoning 2021
10 ATHENA (roberta-large) 91 ATHENA: Mathematical Reasoning with Thought Expansion the-jb/athena-math 2023
11 MMOS-DeepSeekMath-7B(0-shot) 87.6 ✓ An Empirical Study of Data Ability Boundary in LLMs' Math Reasoning cyzhh/MMOS 2024
12 ATHENA (roberta-base) 86.4 ATHENA: Mathematical Reasoning with Thought Expansion the-jb/athena-math 2023
13 MMOS-CODE-34B(0-shot) 85.1 ✓ An Empirical Study of Data Ability Boundary in LLMs' Math Reasoning cyzhh/MMOS 2024
14 OpenMath-CodeLlama-70B (w/ code) 84.7 ✓ OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset kipok/nemo-skills 2024
15 Graph2Tree with RoBERTa 82.2 Are NLP Models really able to Solve Simple Math Word Problems? arkilpatel/SVAMP · debjitpaul/refiner · vedantgaur/symbolic-mwp-reasoning 2021
16 GTS with RoBERTa 81.2 Are NLP Models really able to Solve Simple Math Word Problems? arkilpatel/SVAMP · debjitpaul/refiner · vedantgaur/symbolic-mwp-reasoning 2021
17 MMOS-CODE-7B(0-shot) 78.6 ✓ An Empirical Study of Data Ability Boundary in LLMs' Math Reasoning cyzhh/MMOS 2024
18 LSTM Seq2Seq with RoBERTa 76.9 Are NLP Models really able to Solve Simple Math Word Problems? arkilpatel/SVAMP · debjitpaul/refiner · vedantgaur/symbolic-mwp-reasoning 2021
19 ATHENA (roberta-large) 91 ATHENA: Mathematical Reasoning with Thought Expansion the-jb/athena-math 2023
20 MMOS-DeepSeekMath-7B(0-shot) 87.6 ✓ An Empirical Study of Data Ability Boundary in LLMs' Math Reasoning cyzhh/MMOS 2024
1–20 / 36 다음 → 페이지당 10 20 50 100