paper-with-me

홈 › Papers

CST5: Data augmentation for Code-Switched Semantic Parsing

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Extending semantic parsers to code-switched input has been a challenging problem, primarily due to lack of labeled data for supervision. In this work, we introduce CST5, a new data augmentation technique that finetunes a T5 model using a small seed set ($\approx$100 utterances) to generate code-switched utterances from English utterances. We demonstrate the effectiveness of CST5 by comparing baseline models which are trained without data augmentation to models which are trained with augmented data for varying amount of training data. By using CST5, one can achieve the same semantic parsing performance by using up to 20x less labeled data. To aid further research, we release over 10k human annotated Hindi-English (Hinglish) code-switched utterances along with 170K CST5 generated code-switched utterances from the TOPv2 dataset. The generated data is of good quality deemed over 98\% natural and 89\% semantically equivalent by native annotators.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationSemantic Parsing

Methods 이 논문이 사용한 방법론

Gated Linear Unit A Gated Linear Unit, or GLU computes: $$ \mathrm{GLU}(a, b) = a \otimes \sigma(b) $$ It is used in natural language processing architectures, for example the Gated CNN,…
Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Inverse Square Root Schedule Inverse Square Root is a learning rate schedule 1 / $\sqrt{\max\left(n, k\right)}$ where $n$ is the current training iteration and $k$ is the number of warm-up steps. This…
Adafactor Adafactor is a stochastic optimization method based on Adam that reduces memory usage while retaining the empirical benefits of…
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…

Similar Papers 제목 키워드 기반

CST5: Data Augmentation for Code-Switched Semantic Parsing

2022-11-14 · Anmol Agarwal, Jigar Gupta, Rahul Goel, Shyam Upadhyay 외

Extending semantic parsers to code-switched input has been a challenging problem, primarily due to a lack of supervised training data. In this work, we introduce CST5, a new data augmentation technique that finetunes a T…

Data AugmentationSemantic Parsing

El Volumen Louder Por Favor: Code-switching in Task-oriented Semantic Parsing

2021-01-26 · EACL 2021 2 · Arash Einolghozati, Abhinav Arora, Lorena Sainz-Maza Lecanda, Anuj Kumar 외

Being able to parse code-switched (CS) utterances, such as Spanish+English or Hindi+English, is essential to democratize task-oriented semantic parsing systems for certain locales. In this work, we focus on Spanglish (Sp…

Data AugmentationSemantic Parsing

Improving Code-Switching Dependency Parsing with Semi-Supervised Auxiliary Tasks

2022-07-01 · Findings (NAACL) 2022 7 · Şaziye Özateş, Arzucan Özgür, Tunga Gungor, Özlem Çetinoğlu

Code-switching dependency parsing stands as a challenging task due to both the scarcity of necessary resources and the structural difficulties embedded in code-switched languages. In this study, we introduce novel sequen…

Dependency ParsingXLM-R

Holistic Exploration on Universal Decompositional Semantic Parsing: Architecture, Data Augmentation, and LLM Paradigm

2023-07-25 · Hexuan Deng, Xin Zhang, Meishan Zhang, Xuebo Liu 외

In this paper, we conduct a holistic exploration of the Universal Decompositional Semantic (UDS) Parsing. We first introduce a cascade model for UDS parsing that decomposes the complex parsing task into semantically appr…

AttributeData AugmentationSemantic Parsing

DAMP: Doubly Aligned Multilingual Parser for Task-Oriented Dialogue

2022-12-15 · William Held, Christopher Hidey, Fei Liu, Eric Zhu 외

Modern virtual assistants use internal semantic parsing engines to convert user utterances to actionable commands. However, prior work has demonstrated that semantic parsing is a difficult multilingual transfer task with…

Semantic ParsingXLM-R