mixSeq: A Simple Data Augmentation Methodfor Neural Machine Translation
Data augmentation, which refers to manipulating the inputs (e.g., adding random noise,masking specific parts) to enlarge the dataset,has been widely adopted in machine learning. Most data augmentation techniques operate on a single input, which limits the diversity of the training corpus. In this paper, we propose a simple yet effective data augmentation technique for neural machine translation, mixSeq, which operates on multiple inputs and their corresponding targets. Specifically, we randomly select two input sequences,concatenate them together as a longer input aswell as their corresponding target sequencesas an enlarged target, and train models on theaugmented dataset. Experiments on nine machine translation tasks demonstrate that such asimple method boosts the baselines by a non-trivial margin. Our method can be further combined with single input based data augmentation methods to obtain further improvements.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationDiversityMachine TranslationTranslationSimilar Papers 제목 키워드 기반
MixSeq: Connecting Macroscopic Time Series Forecasting with Microscopic Time Series Data
Time series forecasting is widely used in business intelligence, e.g., forecast stock market price, sales, and help the analysis of data trend. Most time series of interest are macroscopic time series that are aggregated…
Time SeriesTime Series AnalysisTime Series ForecastingDecawave UWB clock drift correction and powerself-calibration
The position accuracy based on Decawave Ultra-Wideband (UWB) is affectedmainly by three factors: hardware delays, clock drift, and signal power. Thisarticle discusses the last two factors. The general approach to clock d…
PositionGreedy Policy Search: A Simple Baseline for Learnable Test-Time Augmentation
Test-time data augmentation$-$averaging the predictions of a machine learning model across multiple augmented samples of data$-$is a widely used technique that improves the predictive performance. While many advanced lea…
Data Augmentationimage-classificationImage ClassificationMulti-Modal Discussion Transformer: Integrating Text, Images and Graph Transformers to Detect Hate Speech on Social Media
We present the Multi-Modal Discussion Transformer (mDT), a novel methodfor detecting hate speech in online social networks such as Reddit discussions. In contrast to traditional comment-only methods, our approach to labe…
Effective Data Augmentation for Sentence Classification Using One VAE per Class
In recent years, data augmentation has become an important field of machine learning. While images can use simple techniques such as cropping or rotating, textual data augmentation needs more complex manipulations to ens…
Binary ClassificationData AugmentationSentenceSentence Classification