paper-with-me

홈 › Papers

CST5: Data Augmentation for Code-Switched Semantic Parsing

2022-11-14 · Anmol Agarwal, Jigar Gupta, Rahul Goel, Shyam Upadhyay, Pankaj Joshi, Rengarajan Aravamudhan

Extending semantic parsers to code-switched input has been a challenging problem, primarily due to a lack of supervised training data. In this work, we introduce CST5, a new data augmentation technique that finetunes a T5 model using a small seed set ($\approx$100 utterances) to generate code-switched utterances from English utterances. We show that CST5 generates high quality code-switched data, both intrinsically (per human evaluation) and extrinsically by comparing baseline models which are trained without data augmentation to models which are trained with augmented data. Empirically we observe that using CST5, one can achieve the same semantic parsing performance by using up to 20x less labeled data. To aid further research in this area, we are also releasing (a) Hinglish-TOP, the largest human annotated code-switched semantic parsing dataset to date, containing 10k human annotated Hindi-English (Hinglish) code-switched utterances, and (b) Over 170K CST5 generated code-switched utterances from the TOPv2 dataset. Human evaluation shows that both the human annotated data as well as the CST5 generated data is of good quality.

📄 PDF Abstract BibTeX arXiv:2211.07514

Code (1)

google-research-datasets/hinglish-top-dataset 공식 구현

Tasks

Data AugmentationSemantic Parsing

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

CST5: Data augmentation for Code-Switched Semantic Parsing

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Extending semantic parsers to code-switched input has been a challenging problem, primarily due to lack of labeled data for supervision. In this work, we introduce CST5, a new data augmentation technique that finetunes …

Data AugmentationSemantic Parsing

El Volumen Louder Por Favor: Code-switching in Task-oriented Semantic Parsing

2021-01-26 · EACL 2021 2 · Arash Einolghozati, Abhinav Arora, Lorena Sainz-Maza Lecanda, Anuj Kumar 외

Being able to parse code-switched (CS) utterances, such as Spanish+English or Hindi+English, is essential to democratize task-oriented semantic parsing systems for certain locales. In this work, we focus on Spanglish (Sp…

Data AugmentationSemantic Parsing

Improving Code-Switching Dependency Parsing with Semi-Supervised Auxiliary Tasks

2022-07-01 · Findings (NAACL) 2022 7 · Şaziye Özateş, Arzucan Özgür, Tunga Gungor, Özlem Çetinoğlu

Code-switching dependency parsing stands as a challenging task due to both the scarcity of necessary resources and the structural difficulties embedded in code-switched languages. In this study, we introduce novel sequen…

Dependency ParsingXLM-R

Holistic Exploration on Universal Decompositional Semantic Parsing: Architecture, Data Augmentation, and LLM Paradigm

2023-07-25 · Hexuan Deng, Xin Zhang, Meishan Zhang, Xuebo Liu 외

In this paper, we conduct a holistic exploration of the Universal Decompositional Semantic (UDS) Parsing. We first introduce a cascade model for UDS parsing that decomposes the complex parsing task into semantically appr…

AttributeData AugmentationSemantic Parsing

DAMP: Doubly Aligned Multilingual Parser for Task-Oriented Dialogue

2022-12-15 · William Held, Christopher Hidey, Fei Liu, Eric Zhu 외

Modern virtual assistants use internal semantic parsing engines to convert user utterances to actionable commands. However, prior work has demonstrated that semantic parsing is a difficult multilingual transfer task with…

Semantic ParsingXLM-R