Improving Data Augmentation in Low-resource Question Answering with Active Learning in Multiple Stages
Neural approaches have become very popular in the domain of Question Answering, however they require a large amount of annotated data. Furthermore, they often yield very good performance but only in the domain they were trained on. In this work we propose a novel approach that combines data augmentation via question-answer generation and active learning to improve performance in low resource settings, where the target domain is vastly different from the source domain. Furthermore, we investigate data augmentation via generation for question answering in three different low-resource settings relevant in practice and how this can be improved: 1) No labels for the target domain, 2) static, labelled data for the target domain and 3) an Active Learning approach with labels for the target domain provided by an expert. In all settings we assume sufficient amount of labelled data from the source domain is available. We perform extensive experiments in each of the above conditions. Our findings show that our novel approach, which combines data augmentation with active learning, boosts performances in the low-resource, domain-specific setting, allowing for low-labelling-effort question answering systems in new, specialized domains. They further demonstrate how to best utilize data augmentation to boost performance in these settings.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningAnswer GenerationData AugmentationQuestion-Answer-GenerationQuestion AnsweringSimilar Papers 제목 키워드 기반
Combining Data Generation and Active Learning for Low-Resource Question Answering
Neural approaches have become very popular in Question Answering (QA), however, they require a large amount of annotated data. In this work, we propose a novel approach that combines data augmentation via question-answer…
Active LearningAnswer GenerationData AugmentationQuestion-Answer-Generation+2Unified Question Answering in Slovene
Question answering is one of the most challenging tasks in language understanding. Most approaches are developed for English, while less-resourced languages are much less researched. We adapt a successful English questio…
Cross-Lingual TransferDecoderMultiple-choiceQuestion AnsweringMosaic Augmentation for Text: Cropping and Collaging as Cross-Domain Techniques
We present new visually inspired cropping and collaging data augmentations for text. We test how these augmentations impact data-scarce scenarios over multiple NLP tasks: name entity recognition, extractive question answ…
Abstractive Text SummarizationExtractive Question-AnsweringQuestion AnsweringINDIC QA BENCHMARK: A Multilingual Benchmark to Evaluate Question Answering capability of LLMs for Indic Languages
Large Language Models (LLMs) have demonstrated remarkable zero-shot and few-shot capabilities in unseen tasks, including context-grounded question answering (QA) in English. However, the evaluation of LLMs' capabilities …
abstractive question answeringQuestion AnsweringOn the Summarization of Consumer Health Questions
Question understanding is one of the main challenges in question answering. In real world applications, users often submit natural language questions that are longer than needed and include peripheral information that in…
Data AugmentationQuestion AnsweringRetrieval