SQLformer: Deep Auto-Regressive Query Graph Generation for Text-to-SQL Translation
In recent years, the task of text-to-SQL translation, which converts natural language questions into executable SQL queries, has gained significant attention for its potential to democratize data access. Despite its promise, challenges such as adapting to unseen databases and aligning natural language with SQL syntax have hindered widespread adoption. To overcome these issues, we introduce SQLformer, a novel Transformer architecture specifically crafted to perform text-to-SQL translation tasks. Our model predicts SQL queries as abstract syntax trees (ASTs) in an autoregressive way, incorporating structural inductive bias in the encoder and decoder layers. This bias, guided by database table and column selection, aids the decoder in generating SQL query ASTs represented as graphs in a Breadth-First Search canonical order. Our experiments demonstrate that SQLformer achieves state-of-the-art performance across six prominent text-to-SQL benchmarks.
Code (1)
Tasks
DecoderGraph GenerationInductive BiasText to SQLText-To-SQLTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Autoregressive Models for Knowledge Graph Generation
Knowledge Graph (KG) generation requires models to learn complex semantic dependencies between triples while maintaining domain validity constraints. Unlike link prediction, which scores triples independently, generative…
Computational EfficiencyGraph GenerationLink PredictionOutlining and Filling: Hierarchical Query Graph Generation for Answering Complex Questions over Knowledge Graphs
Query graph construction aims to construct the correct executable SPARQL on the KG to answer natural language questions. Although recent methods have achieved good results using neural network-based query graph ranking, …
graph constructionGraph GenerationGraph RankingKnowledge Base Question Answering+1G3PT: Unleash the power of Autoregressive Modeling in 3D Generation via Cross-scale Querying Transformer
Autoregressive transformers have revolutionized generative models in language processing and shown substantial promise in image and video generation. However, these models face significant challenges when extended to 3D …
3D GenerationVideo GenerationAssemble Your Crew: Automatic Multi-agent Communication Topology Design via Autoregressive Graph Generation
Multi-agent systems (MAS) based on large language models (LLMs) have emerged as a powerful solution for dealing with complex problems across diverse domains. The effectiveness of MAS is critically dependent on its collab…
Graph GenerationTowards Fast Graph Generation via Autoregressive Noisy Filtration Modeling
Graph generative models often face a critical trade-off between learning complex distributions and achieving fast generation speed. We introduce Autoregressive Noisy Filtration Modeling (ANFM), a novel approach that addr…
Graph GenerationTopological Data Analysis