paper-with-me

Papers

ZAS-SQL: Distilling Rules from Failures for Zero-Shot Text-to-SQL

2026-06-06 · Hongzhou Zheng, Yixin Gou, Wenjia Zhang arxiv

Text-to-SQL translates natural language into executable SQL queries. Few-shot in-context learning methods built upon large language models (LLMs) achieve strong performance, yet their reliance on demonstrations limits cross-domain generalization and consumes substantial context window space. Existing zero-shot methods, lacking effective generation constraints, still fall short of few-shot approaches. We observe that LLM failures in zero-shot Text-to-SQL are not random but exhibit systematic, recurring patterns. Building on this observation, we propose a fully zero-shot Text-to-SQL framework that distills core generation rules from failure cases through a Map-Reduce-based rule distillation pipeline and improves generation quality via three complementary modules: knowledge-augmented schema representation, which supplements missing semantics in Data Definition Language; a rule-driven structured reasoning framework that suppresses structural deviations; and Execution-Guided Early Stopping, which enables low-cost self-correction. On Spider, the proposed framework achieves up to 87.2% and 88.6% execution accuracy on the Dev and Test sets, respectively, establishing a new zero-shot state-of-the-art and surpassing multiple few-shot and fine-tuning methods built upon GPT-4/4o. On the domain-specific dataset UrbanPlan, it achieves 81.3%, confirming that the rule distillation approach generalizes across domains. Moreover, when equipped with a 4B-parameter model, the framework surpasses zero-shot baselines of leading closed-source models, demonstrating strong model generality.

📄 PDF Abstract BibTeX arXiv:2606.08245

Code (0)

등록된 구현이 없습니다.

Tasks

Domain Generalization

Results from the Paper

RankTaskDatasetModelMetrics
#11 Text-To-SQL spider ZAS-SQL Execution Accuracy (Test): 87.2

Similar Papers 제목 키워드 기반

Reliable Neural-Codec Text-to-Speech by ASR Self-Verification and Distillation: Near-Zero Catastrophic Failures Across Models and Codecs

2026-06-16 · Ali Asaria, Tony Salomone, Deep Gandhi arxiv

Open autoregressive neural-codec text-to-speech (TTS) models sound excellent on typical inputs yet suffer stochastic catastrophic failures: on a meaningful fraction of utterances they emit silence, terminate early, or co…

Training-Free Test-Time Contrastive Learning for Large Language Models

2026-04-15 · Kaiwen Zheng, Kai Zhou, Jinwu Hu, Te Gu 외 arxiv

Large language models (LLMs) demonstrate strong reasoning capabilities, but their performance often degrades under distribution shift. Existing test-time adaptation (TTA) methods rely on gradient-based updates that requi…

Test-time AdaptationContrastive Learning

Distilling Hypernymy Relations from Language Models: On the Effectiveness of Zero-Shot Taxonomy Induction

2022-02-10 · *SEM (NAACL) 2022 7 · Devansh Jain, Luis Espinosa Anke

In this paper, we analyze zero-shot taxonomy learning methods which are based on distilling knowledge from language models via prompting and sentence scoring. We show that, despite their simplicity, these methods outperf…

Sentence

Visually Analyzing and Steering Zero Shot Learning

2020-09-11 · Saroj Sahoo, Matthew Berger

We propose a visual analytics system to help a user analyze and steer zero-shot learning models. Zero-shot learning has emerged as a viable scenario for categorizing data that consists of no labeled examples, and thus a …

Zero-Shot Learning

Distilling Large Language Models for Text-Attributed Graph Learning

2024-02-19 · Bo Pan, Zheng Zhang, Yifei Zhang, Yuntong Hu 외

Text-Attributed Graphs (TAGs) are graphs of connected textual documents. Graph models can efficiently learn TAGs, but their training heavily relies on human-annotated labels, which are scarce or even unavailable in many …

Graph LearningTAG