paper-with-me

홈 › Papers

Controllable Semantic Parsing via Retrieval Augmentation

2021-10-16 · EMNLP 2021 11 · Panupong Pasupat, Yuan Zhang, Kelvin Guu

In practical applications of semantic parsing, we often want to rapidly change the behavior of the parser, such as enabling it to handle queries in a new domain, or changing its predictions on certain targeted queries. While we can introduce new training examples exhibiting the target behavior, a mechanism for enacting such behavior changes without expensive model re-training would be preferable. To this end, we propose ControllAble Semantic Parser via Exemplar Retrieval (CASPER). Given an input query, the parser retrieves related exemplars from a retrieval index, augments them to the query, and then applies a generative seq2seq model to produce an output parse. The exemplars act as a control mechanism over the generic generative model: by manipulating the retrieval index or how the augmented query is constructed, we can manipulate the behavior of the parser. On the MTOP dataset, in addition to achieving state-of-the-art on the standard setup, we show that CASPER can parse queries in a new domain, adapt the prediction toward the specified patterns, or adapt to new semantic schemas without having to further re-train the model.

📄 PDF Abstract BibTeX arXiv:2110.08458

Code (1)

google-research/language/tree/master/language/casper 공식 구현 jax

Tasks

RetrievalSemantic Parsing

Methods 이 논문이 사용한 방법론

Tanh Activation 설명 없음
Sigmoid Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Seq2Seq Seq2Seq, or Sequence To Sequence, is a model used in sequence prediction tasks, such as language modelling and machine translation. The idea is to use one…

Similar Papers 제목 키워드 기반

Hierarchical Neural Data Synthesis for Semantic Parsing

2021-12-04 · Wei Yang, Peng Xu, Yanshuai Cao

Semantic parsing datasets are expensive to collect. Moreover, even the questions pertinent to a given domain, which are the input of a semantic parsing system, might not be readily available, especially in cross-domain s…

Data AugmentationSemantic ParsingText to SQLText-To-SQL

Holistic Exploration on Universal Decompositional Semantic Parsing: Architecture, Data Augmentation, and LLM Paradigm

2023-07-25 · Hexuan Deng, Xin Zhang, Meishan Zhang, Xuebo Liu 외

In this paper, we conduct a holistic exploration of the Universal Decompositional Semantic (UDS) Parsing. We first introduce a cascade model for UDS parsing that decomposes the complex parsing task into semantically appr…

AttributeData AugmentationSemantic Parsing

Retrieval-Augmented Semantic Parsing: Using Large Language Models to Improve Generalization

2024-12-13 · Xiao Zhang, Qianru Meng, Johan Bos

Open-domain semantic parsing remains a challenging task, as models often rely on heuristics and struggle to handle unseen concepts. In this paper, we investigate the potential of large language models (LLMs) for this tas…

DecoderRetrievalSemantic Parsing

Generate-and-Retrieve: use your predictions to improve retrieval for semantic parsing

2022-09-29 · COLING 2022 10 · Yury Zemlyanskiy, Michiel de Jong, Joshua Ainslie, Panupong Pasupat 외

A common recent approach to semantic parsing augments sequence-to-sequence models by retrieving and appending a set of training samples, called exemplars. The effectiveness of this recipe is limited by the ability to ret…

PredictionRetrievalSemantic Parsing

SUBS: Subtree Substitution for Compositional Semantic Parsing

2022-05-03 · NAACL 2022 7 · Jingfeng Yang, Le Zhang, Diyi Yang

Although sequence-to-sequence models often achieve good performance in semantic parsing for i.i.d. data, their performance is still inferior in compositional generalization. Several data augmentation methods have been pr…

Data AugmentationSemantic Parsing