paper-with-me

Papers

Learning to Synthesize Data for Semantic Parsing

2021-04-12 · NAACL 2021 4 · Bailin Wang, Wenpeng Yin, Xi Victoria Lin, Caiming Xiong

Synthesizing data for semantic parsing has gained increasing attention recently. However, most methods require handcrafted (high-precision) rules in their generative process, hindering the exploration of diverse unseen data. In this work, we propose a generative model which features a (non-neural) PCFG that models the composition of programs (e.g., SQL), and a BART-based translation model that maps a program to an utterance. Due to the simplicity of PCFG and pre-trained BART, our generative model can be efficiently learned from existing data at hand. Moreover, explicitly modeling compositions using PCFG leads to a better exploration of unseen programs, thus generate more diverse data. We evaluate our method in both in-domain and out-of-domain settings of text-to-SQL parsing on the standard benchmarks of GeoQuery and Spider, respectively. Our empirical results show that the synthesized data generated from our model can substantially help a semantic parser achieve better compositional and domain generalization.

📄 PDF Abstract BibTeX arXiv:2104.05827

Code (1)

berlino/tensor2struct-public 공식 구현 pytorch

Tasks

Domain GeneralizationSemantic ParsingSQL ParsingText to SQLText-To-SQLTranslation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Hierarchical Neural Data Synthesis for Semantic Parsing

2021-12-04 · Wei Yang, Peng Xu, Yanshuai Cao

Semantic parsing datasets are expensive to collect. Moreover, even the questions pertinent to a given domain, which are the input of a semantic parsing system, might not be readily available, especially in cross-domain s…

Data AugmentationSemantic ParsingText to SQLText-To-SQL

Grounded Adaptation for Zero-shot Executable Semantic Parsing

2020-09-16 · EMNLP 2020 11 · Victor Zhong, Mike Lewis, Sida I. Wang, Luke Zettlemoyer

We propose Grounded Adaptation for Zero-shot Executable Semantic Parsing (GAZP) to adapt an existing semantic parser to new environments (e.g. new database schemas). GAZP combines a forward semantic parser with a backwar…

Data AugmentationDialogue State TrackingSemantic ParsingText-To-SQL

Program Synthesis and Semantic Parsing with Learned Code Idioms

2019-06-26 · NeurIPS 2019 12 · Richard Shin, Miltiadis Allamanis, Marc Brockschmidt, Oleksandr Polozov

Program synthesis of general-purpose source code from natural language specifications is challenging due to the need to reason about high-level patterns in the target program and low-level implementation details at the s…

Code GenerationProgram SynthesisSemantic Parsing

Cross-lingual Back-Parsing: Utterance Synthesis from Meaning Representation for Zero-Resource Semantic Parsing

2024-10-01 · Deokhyung Kang, Seonjeong Hwang, Yunsu Kim, Gary Geunbae Lee

Recent efforts have aimed to utilize multilingual pretrained language models (mPLMs) to extend semantic parsing (SP) across multiple languages without requiring extensive annotations. However, achieving zero-shot cross-l…

Cross-Lingual TransferData AugmentationSemantic ParsingZero-Shot Cross-Lingual Transfer

Interactive Semantic Parsing for If-Then Recipes via Hierarchical Reinforcement Learning

2018-08-21 · Ziyu Yao, Xiujun Li, Jianfeng Gao, Brian Sadler 외

Given a text description, most existing semantic parsers synthesize a program in one shot. However, it is quite challenging to produce a correct program solely based on the description, which in reality is often ambiguou…

Hierarchical Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1