Text-To-SQL 벤치마크
Text-To-SQL on spider
Execution Accuracy (Test)
- 2021-09-10 — T5-3B + PICARD: Execution Accuracy (Test) 75.1
- 2023-01-18 — Graphix-3B+PICARD: Execution Accuracy (Test) 77.6
- 2023-02-12 — RESDSQL-3B + NatSQL: Execution Accuracy (Test) 79.9
- 2023-04-21 — DIN-SQL + GPT-4: Execution Accuracy (Test) 85.3
- 2023-08-29 — DAIL-SQL + GPT-4 + Self-Consistency: Execution Accuracy (Test) 86.6
- 2024-03-13 — PET-SQL: Execution Accuracy (Test) 87.6
- 2024-11-13 — XiYan-SQL: Execution Accuracy (Test) 89.65
- 2025-11-02 — MARS-SQL: Execution Accuracy (Test) 89.75
- 2025-11-21 — AutoLink: Execution Accuracy (Test) 91.2
- 2026-08-01 — AttnLink: Execution Accuracy (Test) 95.95