paper-with-me

홈 › Papers

CSS: A Large-scale Cross-schema Chinese Text-to-SQL Medical Dataset

2023-05-25 · Hanchong Zhang, Jieyu Li, Lu Chen, Ruisheng Cao, Yunyan Zhang, Yu Huang, Yefeng Zheng, Kai Yu

The cross-domain text-to-SQL task aims to build a system that can parse user questions into SQL on complete unseen databases, and the single-domain text-to-SQL task evaluates the performance on identical databases. Both of these setups confront unavoidable difficulties in real-world applications. To this end, we introduce the cross-schema text-to-SQL task, where the databases of evaluation data are different from that in the training data but come from the same domain. Furthermore, we present CSS, a large-scale CrosS-Schema Chinese text-to-SQL dataset, to carry on corresponding studies. CSS originally consisted of 4,340 question/SQL pairs across 2 databases. In order to generalize models to different medical systems, we extend CSS and create 19 new databases along with 29,280 corresponding dataset examples. Moreover, CSS is also a large corpus for single-domain Chinese text-to-SQL studies. We present the data collection approach and a series of analyses of the data statistics. To show the potential and usefulness of CSS, benchmarking baselines have been conducted and reported. Our dataset is publicly available at \url{https://huggingface.co/datasets/zhanghanchong/css}.

📄 PDF Abstract BibTeX arXiv:2305.15891

Code (1)

x-lance/medical-dataset 공식 구현

Tasks

BenchmarkingText to SQLText-To-SQL

Similar Papers 제목 키워드 기반

Falcon: A Comprehensive Chinese Text-to-SQL Benchmark for Enterprise-Grade Evaluation

2025-10-23 · Wenzhen Luo, Wei Guan, Yifan Yao, Yimin Pan 외 arxiv

We introduce Falcon, a cross-domain Chinese text-to-SQL benchmark grounded in an enterprise-compatible dialect (MaxCompute/Hive). It contains 600 Chinese questions over 28 databases; 77% require multi-table reasoning and…

ScrapeGraphAI-100k: Dataset for Schema-Constrained LLM Generation

2026-02-16 · William Brach, Francesco Zuppichini, Marco Vinciguerra, Lorenzo Padoan arxiv

Producing output that conforms to a specified JSON schema underlies tool use, structured extraction, and knowledge base construction in modern large language models. Despite this centrality, public datasets for the task …

IEPile: Unearthing Large-Scale Schema-Based Information Extraction Corpus

2024-02-22 · Honghao Gui, Lin Yuan, Hongbin Ye, Ningyu Zhang 외

Large Language Models (LLMs) demonstrate remarkable potential across various domains; however, they exhibit a significant performance gap in Information Extraction (IE). Note that high-quality instruction data is the vit…

Zero-shot Generalization

EntSQL: A Benchmark for Grounding Text-to-SQL in Long-Context Enterprise Knowledge

2026-06-02 · Chengxi Liao, Tao Xu, Zulong Chen, Chuanfei Xu 외 arxiv

Text-to-SQL enables natural language access to databases, and recent LLMs have substantially advanced its capabilities. Existing benchmarks such as Spider, BIRD, and Spider~2.0 evaluate schema generalization, large-scale…

MultiSpider: Towards Benchmarking Multilingual Text-to-SQL Semantic Parsing

2022-12-27 · Longxu Dou, Yan Gao, Mingyang Pan, Dingzirui Wang 외

Text-to-SQL semantic parsing is an important NLP task, which greatly facilitates the interaction between users and the database and becomes the key component in many human-computer interaction systems. Much recent progre…

BenchmarkingSemantic ParsingText to SQLText-To-SQL