Cheap and Good? Simple and Effective Data Augmentation for Low Resource Machine Reading
We propose a simple and effective strategy for data augmentation for low-resource machine reading comprehension (MRC). Our approach first pretrains the answer extraction components of a MRC system on the augmented data that contains approximate context of the correct answers, before training it on the exact answer spans. The approximate context helps the QA method components in narrowing the location of the answers. We demonstrate that our simple strategy substantially improves both document retrieval and answer extraction performance by providing larger context of the answers and additional training data. In particular, our method significantly improves the performance of BERT based retriever (15.12\%), and answer extractor (4.33\% F1) on TechQA, a complex, low-resource MRC task. Further, our data augmentation strategy yields significant improvements of up to 3.9\% exact match (EM) and 2.7\% F1 for answer extraction on PolicyQA, another practical but moderate sized QA dataset that also contains long answer spans.
Code (1)
Tasks
Data AugmentationMachine Reading ComprehensionReading ComprehensionRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
FiGURe: Simple and Efficient Unsupervised Node Representations with Filter Augmentations
Unsupervised node representations learnt using contrastive learning-based methods have shown good performance on downstream tasks. However, these methods rely on augmentations that mimic low-pass filters, limiting their …
Contrastive LearningEffective Data Augmentation for Sentence Classification Using One VAE per Class
In recent years, data augmentation has become an important field of machine learning. While images can use simple techniques such as cropping or rotating, textual data augmentation needs more complex manipulations to ens…
Binary ClassificationData AugmentationSentenceSentence ClassificationStochastic Monkeys at Play: Random Augmentations Cheaply Break LLM Safety Alignment
Safety alignment of Large Language Models (LLMs) has recently become a critical objective of model developers. In response, a growing body of work has been investigating how safety alignment can be bypassed through vario…
QuantizationSafety AlignmentPASTA: Proportional Amplitude Spectrum Training Augmentation for Syn-to-Real Domain Generalization
Synthetic data offers the promise of cheap and bountiful training data for settings where labeled real-world data is scarce. However, models trained on synthetic data significantly underperform when evaluated on real-wor…
Domain Generalizationobject-detectionObject DetectionObject Recognition+1Good-Enough Example Extrapolation
This paper asks whether extrapolating the hidden space distribution of text examples from one class onto another is a valid inductive bias for data augmentation. To operationalize this question, I propose a simple data a…
Data AugmentationInductive Biastext-classificationText Classification+1