paper-with-me

홈 › Papers

SeqGenSQL -- A Robust Sequence Generation Model for Structured Query Language

2020-11-07 · Ning li, Bethany Keller, Mark Butler, Daniel Cer

We explore using T5 (Raffel et al. (2019)) to directly translate natural language questions into SQL statements. General purpose natural language that interfaces to information stored within databases requires flexibly translating natural language questions into database queries. The best performing text-to-SQL systems approach this task by first converting questions into an intermediate logical form (LF) (Lyu et al. (2020)). While LFs provide a convenient intermediate representation and simplify query generation, they introduce an additional layer of complexity and annotation requirements. However, weakly supervised modeling that directly converts questions to SQL statements has proven more difficult without the scaffolding provided by LFs (Min et al. (2019)). We approach direct conversion of questions to SQL statements using T5 (Raffel et al. (2019)), a pre-trained textto-text generation model, modified to support pointer-generator style decoding (See et al. (2017)). We explore using question augmentation with table schema information and the use of automatically generated silver training data. The resulting model achieves 90.5% execution accuracy on the WikiSQL (Zhong et al. (2017)) test data set, a new state-of-the-art on weakly supervised SQL generation. The performance improvement is 6.6% absolute over the prior state-of-the-art (Min et al. (2019)) and approaches the performance of state-ofthe-art systems making use of LFs.

📄 PDF Abstract BibTeX arXiv:2011.03836

Code (2)

salesforce/WikiSQL 공식 구현
louis-li/SeqGenSQL pytorch

Tasks

Text GenerationText to SQLText-To-SQL

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Inverse Square Root Schedule Inverse Square Root is a learning rate schedule 1 / $\sqrt{\max\left(n, k\right)}$ where $n$ is the current training iteration and $k$ is the number of warm-up steps. This…
SentencePiece 설명 없음
Adafactor Adafactor is a stochastic optimization method based on Adam that reduces memory usage while retaining the empirical benefits of…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

SQL-to-Text Generation with Graph-to-Sequence Model

2018-09-14 · EMNLP 2018 10 · Kun Xu, Lingfei Wu, Zhiguo Wang, Yansong Feng 외

Previous work approaches the SQL-to-text generation task using vanilla Seq2Seq models, which may not fully capture the inherent graph-structured information in SQL query. In this paper, we first introduce a strategy to r…

Graph-to-SequenceSQL-to-TextText Generation

SPOC-SQL: Stage-wise Preference Optimization for Controllable Text-to-SQL

2026-08-24 · Yingnan Chen, Chun Ding, Tianshi Xu, Xu Yang 외 arxiv

Text-to-SQL aims to translate natural language questions into executable SQL queries over relational databases, requiring multi-stage structured reasoning over database schemas and query constraints. However, existing me…

DynaQuery: A Self-Adapting Framework for Querying Structured and Multimodal Data

2025-10-20 · Aymane Hassini arxiv

The rise of Large Language Models (LLMs) has accelerated the long-standing goal of enabling natural language querying over complex, hybrid databases. Yet, this ambition exposes a dual challenge: reasoning jointly over st…

A causal framework for explaining the predictions of black-box sequence-to-sequence models

2017-07-06 · EMNLP 2017 9 · David Alvarez-Melis, Tommi S. Jaakkola

We interpret the predictions of any black-box structured input-structured output model around a specific input-output pair. Our method returns an "explanation" consisting of groups of input-output tokens that are causall…

OsmT: Bridging OpenStreetMap Queries and Natural Language with Open-source Tag-aware Language Models

2025-12-04 · Zhuoyue Wan, Wentao Hu, Chen Jason Zhang, Yuanfeng Song 외 arxiv

Bridging natural language and structured query languages is a long-standing challenge in the database community. While recent advances in language models have shown promise in this direction, existing solutions often rel…