Visual Question Answering (VQA) 벤치마크
Visual Question Answering (VQA) on PlotQA-D2
1:1 Accuracy
- 2019-08-05 — PReFIL: 1:1 Accuracy 10.37
- 2019-09-03 — PlotQA: 1:1 Accuracy 22.52
- 2021-11-29 — CRCT: 1:1 Accuracy 34.44
- 2024-01-01 — MatCha4096 + LaMenDa: 1:1 Accuracy 91.84
| Rank | Model | 1:1 Accuracy | Paper | Code | Year |
|---|---|---|---|---|---|
| 1 | MatCha4096 + LaMenDa | 91.84 | Synthesize Step-by-Step: Tools Templates and LLMs as Data Generators for Reasoning-Based Chart VQA | 2024 | |
| 2 | CRCT | 34.44 | Classification-Regression for Chart Comprehension | levymsn/cqa-crct | 2021 |
| 3 | PlotQA | 22.52 | PlotQA: Reasoning over Scientific Plots | 2019 | |
| 4 | PReFIL | 10.37 | Answering Questions about Data Visualizations using Efficient Bimodal Fusion | kushalkafle/PREFIL | 2019 |