Visual Question Answering (VQA) 벤치마크
Visual Question Answering (VQA) on PlotQA-D1
1:1 Accuracy
- 2019-08-05 — PReFIL: 1:1 Accuracy 57.91
- 2021-11-29 — CRCT: 1:1 Accuracy 76.94
- 2024-01-01 — MatCha4096 + LaMenDa: 1:1 Accuracy 93.94
| Rank | Model | 1:1 Accuracy | Paper | Code | Year |
|---|---|---|---|---|---|
| 1 | MatCha4096 + LaMenDa | 93.94 | Synthesize Step-by-Step: Tools Templates and LLMs as Data Generators for Reasoning-Based Chart VQA | 2024 | |
| 2 | CRCT | 76.94 | Classification-Regression for Chart Comprehension | levymsn/cqa-crct | 2021 |
| 3 | PReFIL | 57.91 | Answering Questions about Data Visualizations using Efficient Bimodal Fusion | kushalkafle/PREFIL | 2019 |
| 4 | PlotQA | 53.96 | PlotQA: Reasoning over Scientific Plots | 2019 |