SSMix: Saliency-Based Span Mixup for Text Classification
Data augmentation with mixup has shown to be effective on various computer vision tasks. Despite its great success, there has been a hurdle to apply mixup to NLP tasks since text consists of discrete tokens with variable length. In this work, we propose SSMix, a novel mixup method where the operation is performed on input text rather than on hidden vectors like previous approaches. SSMix synthesizes a sentence while preserving the locality of two original texts by span-based mixing and keeping more tokens related to the prediction relying on saliency information. With extensive experiments, we empirically validate that our method outperforms hidden-level mixup methods on a wide range of text classification benchmarks, including textual entailment, sentiment classification, and question-type classification. Our code is available at https://github.com/clovaai/ssmix.
Code (1)
Tasks
ClassificationData AugmentationNatural Language InferenceSentenceSentiment AnalysisSentiment Classificationtext-classificationText ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Supervision Interpolation via LossMix: Generalizing Mixup for Object Detection and Beyond
The success of data mixing augmentations in image classification tasks has been well-received. However, these techniques cannot be readily applied to object detection due to challenges such as spatial misalignment, foreg…
Domain Adaptationimage-classificationImage ClassificationObject+3GuidedMixup: An Efficient Mixup Strategy Guided by Saliency Maps
Data augmentation is now an essential part of the image training process, as it effectively prevents overfitting and makes the model more robust against noisy datasets. Recent mixing augmentation strategies have advanced…
Data AugmentationTokenMixup: Efficient Attention-guided Token-level Data Augmentation for Transformers
Mixup is a commonly adopted data augmentation technique for image classification. Recent advances in mixup methods primarily focus on mixing based on saliency. However, many saliency detectors require intense computation…
Data Augmentationimage-classificationImage ClassificationSageMix: Saliency-Guided Mixup for Point Clouds
Data augmentation is key to improving the generalization ability of deep learning models. Mixup is a simple and widely-used data augmentation technique that has proven effective in alleviating the problems of overfitting…
3D Part Segmentation3D Point Cloud Classification3D Point Cloud Data AugmentationData Augmentation+2Graph Transplant: Node Saliency-Guided Graph Mixup with Local Structure Preservation
Graph-structured datasets usually have irregular graph sizes and connectivities, rendering the use of recent data augmentation techniques, such as Mixup, difficult. To tackle this challenge, we present the first Mixup-li…
Data AugmentationGraph Classification