Visual Question Answering 벤치마크
Visual Question Answering on PlotQA-D1
1:1 Accuracy
- 2022-12-19 — MatCha: 1:1 Accuracy 92.3
- 2024-01-01 — MatCha4096 + LaMenDa: 1:1 Accuracy 93.94
| Rank | Model | 1:1 Accuracy | Paper | Code | Year |
|---|---|---|---|---|---|
| 1 | MatCha4096 + LaMenDa | 93.94 | Synthesize Step-by-Step: Tools Templates and LLMs as Data Generators for Reasoning-Based Chart VQA | 2024 | |
| 2 | MatCha | 92.3 | MatCha: Enhancing Visual Language Pretraining with Math Reasoning and Chart Derendering | huggingface/transformers | 2022 |
| 3 | MatCha4096 + LaMenDa | 93.94 | Synthesize Step-by-Step: Tools Templates and LLMs as Data Generators for Reasoning-Based Chart VQA | 2024 | |
| 4 | MatCha | 92.3 | MatCha: Enhancing Visual Language Pretraining with Math Reasoning and Chart Derendering | huggingface/transformers | 2022 |