Learning from Multiple Noisy Augmented Data Sets for Better Cross-Lingual Spoken Language Understanding
Lack of training data presents a grand challenge to scaling out spoken language understanding (SLU) to low-resource languages. Although various data augmentation approaches have been proposed to synthesize training data in low-resource target languages, the augmented data sets are often noisy, and thus impede the performance of SLU models. In this paper we focus on mitigating noise in augmented data. We develop a denoising training approach. Multiple models are trained with data produced by various augmented methods. Those models provide supervision signals to each other. The experimental results show that our method outperforms the existing state of the art by 3.05 and 4.24 percentage points on two benchmark datasets, respectively. The code will be made open sourced on github.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationDenoisingSpoken Language UnderstandingSimilar Papers 제목 키워드 기반
Human-Guided Column Networks: Augmenting Deep Learning with Advice
While extremely successful in several applications, especially with low-level representations; sparse, noisy samples and structured domains (with multiple objects and interactions) are some of the open challenges in most…
Deep LearningHuman-Guided Learning of Column Networks: Augmenting Deep Learning with Advice
Recently, deep models have been successfully applied in several applications, especially with low-level representations. However, sparse, noisy samples and structured domains (with multiple objects and interactions) are …
Adapt, Agree, Aggregate: Semi-Supervised Ensemble Labeling for Graph Convolutional Networks
In this paper, we propose a novel framework that combines ensemble learning with augmented graph structures to improve the performance and robustness of semi-supervised node classification in graphs. By creating multiple…
Ensemble LearningNode ClassificationPseudo LabelLearnable Sequence Augmenter for Triplet Contrastive Learning in Sequential Recommendation
Most existing contrastive learning-based sequential recommendation (SR) methods rely on random operations (e.g., crop, reorder, and substitute) to generate augmented sequences. These methods often struggle to create posi…
Contrastive LearningSelf-Supervised LearningSequential RecommendationTripletAttention-augmented Spatio-Temporal Segmentation for Land Cover Mapping
The availability of massive earth observing satellite data provide huge opportunities for land use and land cover mapping. However, such mapping effort is challenging due to the existence of various land cover classes, n…