paper-with-me

홈 › Papers

RingSQL: Generating Synthetic Data with Schema-Independent Templates for Text-to-SQL Reasoning Models

2026-01-09 · Marko Sterbentz, Kevin Cushing, Cameron Barrie, Kristian J. Hammond arxiv

Recent advances in text-to-SQL systems have been driven by larger models and improved datasets, yet progress is still limited by the scarcity of high-quality training data. Manual data creation is expensive, and existing synthetic methods trade off reliability and scalability. Template-based approaches ensure correct SQL but require schema-specific templates, while LLM-based generation scales easily but lacks quality and correctness guarantees. We introduce RingSQL, a hybrid data generation framework that combines schema-independent query templates with LLM-based paraphrasing of natural language questions. This approach preserves SQL correctness across diverse schemas while providing broad linguistic variety. In our experiments, we find that models trained using data produced by RingSQL achieve an average gain in accuracy of +2.3% across six text-to-SQL benchmarks when compared to models trained on other synthetic data. We make our code available at https://github.com/nu-c3lab/RingSQL.

📄 PDF Abstract BibTeX arXiv:2601.05451

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

More Robust Schema-Guided Dialogue State Tracking via Tree-Based Paraphrase Ranking

2023-03-17 · A. Coca, B. H. Tseng, W. Lin, B. Byrne

The schema-guided paradigm overcomes scalability issues inherent in building task-oriented dialogue (TOD) agents with static ontologies. Instead of operating on dialogue context alone, agents have access to hierarchical …

Dialogue State TrackingDiversity

A Framework for Generating Valid Context-Specific Benchmarks through Expert Guidance

2026-09-15 · Kimberly Le Truong, Nari Johnson, Anna Kawakami, Hoda Heidari arxiv

This paper presents an end-to-end approach for generating context-specific large language model (LLM) benchmark datasets by combining expert input with synthetic data generation. Existing benchmark construction methods o…

Synthetic Data Generation

SING-SQL: A Synthetic Data Generation Framework for In-Domain Text-to-SQL Translation

2025-09-30 · Hasan Alp Caferoğlu, Mehmet Serhat Çelik, Özgür Ulusoy arxiv

Translating natural language questions into SQL has become a core challenge in enabling non-technical users to query databases. While recent work has explored large-scale synthetic data generation to improve model perfor…

Synthetic Data GenerationDomain Generalization

A multi-schematic classifier-independent oversampling approach for imbalanced datasets

2021-07-15 · Saptarshi Bej, Kristian Schultz, Prashant Srivastava, Markus Wolfien 외

Over 85 oversampling algorithms, mostly extensions of the SMOTE algorithm, have been built over the past two decades, to solve the problem of imbalanced datasets. However, it has been evident from previous studies that d…

Benchmarking

ExtractBench: A Benchmark for Schema-Guided Enterprise Document Extraction

2026-07-31 · Boyang Zhang, Adrian Lyjak, Eli Stewart, Zhaoqi Li 외 hf

Enterprise workflows increasingly rely on agents for schema-guided extraction: given a document and a user-defined schema, the agent faithfully follows the schema to produce the correct output with source evidence as gro…