paper-with-me

Papers

Bootstrapping a Crosslingual Semantic Parser

2020-04-06 · Findings of the Association for Computational Linguistics 2020 · Tom Sherborne, Yumo Xu, Mirella Lapata

Recent progress in semantic parsing scarcely considers languages other than English but professional translation can be prohibitively expensive. We adapt a semantic parser trained on a single language, such as English, to new languages and multiple domains with minimal annotation. We query if machine translation is an adequate substitute for training data, and extend this to investigate bootstrapping using joint training with English, paraphrasing, and multilingual pre-trained models. We develop a Transformer-based parser combining paraphrases by ensembling attention over multiple encoders and present new versions of ATIS and Overnight in German and Chinese for evaluation. Experimental results indicate that MT can approximate training data in a new language for accurate parsing when augmented with paraphrasing through multiple MT engines. Considering when MT is inadequate, we also find that using our approach achieves parsing accuracy within 2% of complete translation using only 50% of training data.

📄 PDF Abstract BibTeX arXiv:2004.02585

Code (1)

tomsherborne/bootstrap 공식 구현 pytorch

Tasks

Machine TranslationSemantic ParsingTranslation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Weight Decay 설명 없음
Residual Connection 설명 없음
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Active Dialogue Simulation in Conversational Systems

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Semantic parsing helps conversational systems in satisfying users' requests through dialogues. To train these models, collecting annotated dialogues as a dataset is a very expensive and time-consuming process. In this pa…

Active LearningSemantic Parsing

Constrained Language Models Yield Few-Shot Semantic Parsers

2021-04-18 · EMNLP 2021 11 · Richard Shin, Christopher H. Lin, Sam Thomson, Charles Chen 외

We explore the use of large pretrained language models as few-shot semantic parsers. The goal in semantic parsing is to generate a structured meaning representation given a natural language input. However, language model…

Semantic Parsing

Low-Resource Parsing with Crosslingual Contextualized Representations

2019-09-19 · CONLL 2019 11 · Phoebe Mulcaire, Jungo Kasai, Noah A. Smith

Despite advances in dependency parsing, languages with small treebanks still present challenges. We assess recent approaches to multilingual contextual word representations (CWRs), and compare them for crosslingual trans…

Dependency Parsing

Parsing Natural Language Sentences by Semi-supervised Methods

2015-06-16 · Rudolf Rosa

We present our work on semi-supervised parsing of natural language sentences, focusing on multi-source crosslingual transfer of delexicalized dependency parsers. We first evaluate the influence of treebank annotation sty…

An Imitation Game for Learning Semantic Parsers from User Interaction

2020-05-02 · EMNLP 2020 11 · Ziyu Yao, Yiqi Tang, Wen-tau Yih, Huan Sun 외

Despite the widely successful applications, bootstrapping and fine-tuning semantic parsers are still a tedious process with challenges such as costly data annotation and privacy risks. In this paper, we suggest an altern…

Imitation LearningText to SQLText-To-SQL