paper-with-me

Papers

PG-GSQL: Pointer-Generator Network with Guide Decoding for Cross-Domain Context-Dependent Text-to-SQL Generation

2020-12-01 · COLING 2020 8 · Huajie Wang, Mei Li, Lei Chen

Text-to-SQL is a task of translating utterances to SQL queries, and most existing neural approaches of text-to-SQL focus on the cross-domain context-independent generation task. We pay close attention to the cross-domain context-dependent text-to-SQL generation task, which requires a model to depend on the interaction history and current utterance to generate SQL query. In this paper, we present an encoder-decoder model called PG-GSQL based on the interaction-level encoder and with two effective innovations in decoder to solve cross-domain context-dependent text-to-SQL task. 1) To effectively capture historical information of SQL query and reuse the previous SQL query tokens, we use a hybrid pointer-generator network as decoder to copy tokens from the previous SQL query via pointer, the generator part is utilized to generate new tokens. 2) We propose a guide component to limit the prediction space of vocabulary for avoiding table-column dependency and foreign key dependency errors during decoding phase. In addition, we design a column-table linking mechanism to improve the prediction accuracy of tables. On the challenging cross-domain context-dependent text-to-SQL benchmark SParC, PG-GSQL achieves 34.0{\%} question matching accuracy and 19.0{\%} interaction matching accuracy on the dev set. With BERT augmentation, PG-GSQL obtains 53.1{\%} question matching accuracy and 34.7{\%} interaction matching accuracy on the dev set, outperforms the previous state-of-the-art model by 5.9{\%} question matching accuracy and 5.2{\%} interaction matching accuracy. Our code is publicly available.

📄 PDF Abstract BibTeX

Code (1)

cfhaiteeh/pg-gsql 공식 구현 pytorch

Tasks

DecoderText to SQLText-To-SQL

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Weight Decay 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Residual Connection 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

Translating Natural Language to SQL using Pointer-Generator Networks and How Decoding Order Matters

2018-11-13 · Denis Lukovnikov, Nilesh Chakraborty, Jens Lehmann, Asja Fischer

Translating natural language to SQL queries for table-based question answering is a challenging problem and has received significant attention from the research community. In this work, we extend a pointer-generator and …

Question AnsweringSemantic ParsingTable-based Question Answering

Generating Pertinent and Diversified Comments with Topic-aware Pointer-Generator Networks

2020-05-09 · Junheng Huang, Lu Pan, Kang Xu, Weihua Peng 외

Comment generation, a new and challenging task in Natural Language Generation (NLG), attracts a lot of attention in recent years. However, comments generated by previous work tend to lack pertinence and diversity. In thi…

ArticlesComment GenerationDiversityText Generation

RingSQL: Generating Synthetic Data with Schema-Independent Templates for Text-to-SQL Reasoning Models

2026-01-09 · Marko Sterbentz, Kevin Cushing, Cameron Barrie, Kristian J. Hammond arxiv

Recent advances in text-to-SQL systems have been driven by larger models and improved datasets, yet progress is still limited by the scarcity of high-quality training data. Manual data creation is expensive, and existing…

Tree-constrained Pointer Generator with Graph Neural Network Encodings for Contextual Speech Recognition

2022-07-02 · Guangzhi Sun, Chao Zhang, Philip C. Woodland

Incorporating biasing words obtained as contextual knowledge is critical for many automatic speech recognition (ASR) applications. This paper proposes the use of graph neural network (GNN) encodings in a tree-constrained…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Graph Neural Networkspeech-recognition+1

An Empirical Comparison on Imitation Learning and Reinforcement Learning for Paraphrase Generation

2019-08-28 · IJCNLP 2019 11 · Wanyu Du, Yangfeng Ji

Generating paraphrases from given sentences involves decoding words step by step from a large vocabulary. To learn a decoder, supervised learning which maximizes the likelihood of tokens always suffers from the exposure …

DecoderImitation LearningParaphrase Generationreinforcement-learning+2