paper-with-me

Math Word Problem Solving 벤치마크

Math Word Problem Solving on ParaMAWPS

24개 결과 · ⬇ CSV · JSON

Accuracy (%)

3.21 22.18 41.16 60.13 79.1 2020-06 2026-11 DeBERTa — 74.1 (2020-06-05) DeBERTa — 74.1 (2020-06-05) DeBERTa — 74.1 (2020-06-05) DeBERTa — 74.1 (2020-06-05) DeBERTa (VM) — 79.1 (2023-06-24) GPT-3.5 Turbo (175B) — 73.0 (2023-06-24) GPT-J (6B) — 5.9 (2023-06-24) GPT-3 text-curie-001 (13B) — 4.2 (2023-06-24) GPT-3 text-babbage-001 (6.7B) — 3.21 (2023-06-24) DeBERTa (VM) — 79.1 (2023-06-24) GPT-3.5 Turbo (175B) — 73.0 (2023-06-24) GPT-J (6B) — 5.9 (2023-06-24) GPT-3 text-curie-001 (13B) — 4.2 (2023-06-24) GPT-3 text-babbage-001 (6.7B) — 3.21 (2023-06-24) DeBERTa (VM) — 79.1 (2023-06-24) GPT-3.5 Turbo (175B) — 73.0 (2023-06-24) GPT-J (6B) — 5.9 (2023-06-24) GPT-3 text-curie-001 (13B) — 4.2 (2023-06-24) GPT-3 text-babbage-001 (6.7B) — 3.21 (2023-06-24) DeBERTa (VM) — 79.1 (2023-06-24) GPT-3.5 Turbo (175B) — 73.0 (2023-06-24) GPT-J (6B) — 5.9 (2023-06-24) GPT-3 text-curie-001 (13B) — 4.2 (2023-06-24) GPT-3 text-babbage-001 (6.7B) — 3.21 (2023-06-24) DeBERTa — 74.1 (2020-06-05) DeBERTa (VM) — 79.1 (2023-06-24)
RankModel Accuracy (%) Extra Training Data PaperCodeYear
1 DeBERTa (VM) 79.1 ✓ Math Word Problem Solving by Generating Linguistic Variants of Problem Statements starscream-11813/variational-mathematical-reasoning 2023
2 DeBERTa 74.1 DeBERTa: Decoding-enhanced BERT with Disentangled Attention huggingface/transformers · microsoft/DeBERTa · osu-nlp-group/mind2web · +11 2020
3 GPT-3.5 Turbo (175B) 73.0 Math Word Problem Solving by Generating Linguistic Variants of Problem Statements starscream-11813/variational-mathematical-reasoning 2023
4 GPT-J (6B) 5.9 Math Word Problem Solving by Generating Linguistic Variants of Problem Statements starscream-11813/variational-mathematical-reasoning 2023
5 GPT-3 text-curie-001 (13B) 4.20 Math Word Problem Solving by Generating Linguistic Variants of Problem Statements starscream-11813/variational-mathematical-reasoning 2023
6 GPT-3 text-babbage-001 (6.7B) 3.21 Math Word Problem Solving by Generating Linguistic Variants of Problem Statements starscream-11813/variational-mathematical-reasoning 2023
7 DeBERTa (VM) 79.1 ✓ Math Word Problem Solving by Generating Linguistic Variants of Problem Statements starscream-11813/variational-mathematical-reasoning 2023
8 DeBERTa 74.1 DeBERTa: Decoding-enhanced BERT with Disentangled Attention huggingface/transformers · microsoft/DeBERTa · osu-nlp-group/mind2web · +11 2020
9 GPT-3.5 Turbo (175B) 73.0 Math Word Problem Solving by Generating Linguistic Variants of Problem Statements starscream-11813/variational-mathematical-reasoning 2023
10 GPT-J (6B) 5.9 Math Word Problem Solving by Generating Linguistic Variants of Problem Statements starscream-11813/variational-mathematical-reasoning 2023
11 GPT-3 text-curie-001 (13B) 4.20 Math Word Problem Solving by Generating Linguistic Variants of Problem Statements starscream-11813/variational-mathematical-reasoning 2023
12 GPT-3 text-babbage-001 (6.7B) 3.21 Math Word Problem Solving by Generating Linguistic Variants of Problem Statements starscream-11813/variational-mathematical-reasoning 2023
13 DeBERTa (VM) 79.1 ✓ Math Word Problem Solving by Generating Linguistic Variants of Problem Statements starscream-11813/variational-mathematical-reasoning 2023
14 DeBERTa 74.1 DeBERTa: Decoding-enhanced BERT with Disentangled Attention huggingface/transformers · microsoft/DeBERTa · osu-nlp-group/mind2web · +11 2020
15 GPT-3.5 Turbo (175B) 73.0 Math Word Problem Solving by Generating Linguistic Variants of Problem Statements starscream-11813/variational-mathematical-reasoning 2023
16 GPT-J (6B) 5.9 Math Word Problem Solving by Generating Linguistic Variants of Problem Statements starscream-11813/variational-mathematical-reasoning 2023
17 GPT-3 text-curie-001 (13B) 4.20 Math Word Problem Solving by Generating Linguistic Variants of Problem Statements starscream-11813/variational-mathematical-reasoning 2023
18 GPT-3 text-babbage-001 (6.7B) 3.21 Math Word Problem Solving by Generating Linguistic Variants of Problem Statements starscream-11813/variational-mathematical-reasoning 2023
19 DeBERTa (VM) 79.1 ✓ Math Word Problem Solving by Generating Linguistic Variants of Problem Statements starscream-11813/variational-mathematical-reasoning 2023
20 DeBERTa 74.1 DeBERTa: Decoding-enhanced BERT with Disentangled Attention huggingface/transformers · microsoft/DeBERTa · osu-nlp-group/mind2web · +11 2020
1–20 / 24 다음 → 페이지당 10 20 50 100