UXLA: A Robust Unsupervised Data Augmentation Framework for Zero-Resource Cross-Lingual NLP
Transfer learning has yielded state-of-the-art (SoTA) results in many supervised NLP tasks. However, annotated data for every target task in every target language is rare, especially for low-resource languages. We propose UXLA, a novel unsupervised data augmentation framework for zero-resource transfer learning scenarios. In particular, UXLA aims to solve cross-lingual adaptation problems from a source language task distribution to an unknown target language task distribution, assuming no training label in the target language. At its core, UXLA performs simultaneous self-training with data augmentation and unsupervised sample selection. To show its effectiveness, we conduct extensive experiments on three diverse zero-resource cross-lingual transfer tasks. UXLA achieves SoTA results in all the tasks, outperforming the baselines by a good margin. With an in-depth framework dissection, we demonstrate the cumulative contributions of different components to its success.
Code (0)
등록된 구현이 없습니다.
Tasks
Cross-Lingual TransferData AugmentationNamed Entity Recognition (NER)Natural Language InferenceSelf-Supervised LearningTransfer LearningSimilar Papers 제목 키워드 기반
FLUXLAYER: High-Performance Design for Cross-chain Fragmented Liquidity
Autonomous Market Makers (AMMs) rely on arbitrage to facilitate passive price updates. Liquidity fragmentation poses a complex challenge across different blockchain networks. This paper proposes FluxLayer, a solution to …
XLA: A Robust Unsupervised Data Augmentation Framework for Cross-Lingual NLP
Transfer learning has yielded state-of-the-art (SoTA) results in many supervised NLP tasks. However, annotated data for every target task in every target language is rare, especially for low-resource languages. We propo…
Cross-Lingual TransferData Augmentationnamed-entity-recognitionNamed Entity Recognition+6How to Train Your DRAGON: Diverse Augmentation Towards Generalizable Dense Retrieval
Various techniques have been developed in recent years to improve dense retrieval (DR), such as unsupervised contrastive learning and pseudo-query generation. Existing DRs, however, often suffer from effectiveness tradeo…
Contrastive LearningData AugmentationPassage RetrievalRetrieval+1UniPSDA: Unsupervised Pseudo Semantic Data Augmentation for Zero-Shot Cross-Lingual Natural Language Understanding
Cross-lingual representation learning transfers knowledge from resource-rich data to resource-scarce ones to improve the semantic understanding abilities of different languages. However, previous works rely on shallow un…
Data AugmentationNatural Language UnderstandingQuestion AnsweringRepresentation LearningBeyond Augmentation: Score-Guided Pathological Prior for EEG-based Depression Detection
Deep learning-based Major Depressive Disorder (MDD) detection using Electroencephalography (EEG) is fundamentally constrained by the "small-sample dilemma." Prevailing generative data augmentation methods not only incur …
Few-Shot LearningData Augmentation