paper-with-me

홈 › Papers

Improving Data Augmentation in Low-resource Question Answering with Active Learning in Multiple Stages

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Neural approaches have become very popular in the domain of Question Answering, however they require a large amount of annotated data. Furthermore, they often yield very good performance but only in the domain they were trained on. In this work we propose a novel approach that combines data augmentation via question-answer generation and active learning to improve performance in low resource settings, where the target domain is vastly different from the source domain. Furthermore, we investigate data augmentation via generation for question answering in three different low-resource settings relevant in practice and how this can be improved: 1) No labels for the target domain, 2) static, labelled data for the target domain and 3) an Active Learning approach with labels for the target domain provided by an expert. In all settings we assume sufficient amount of labelled data from the source domain is available. We perform extensive experiments in each of the above conditions. Our findings show that our novel approach, which combines data augmentation with active learning, boosts performances in the low-resource, domain-specific setting, allowing for low-labelling-effort question answering systems in new, specialized domains. They further demonstrate how to best utilize data augmentation to boost performance in these settings.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Active LearningAnswer GenerationData AugmentationQuestion-Answer-GenerationQuestion Answering

Similar Papers 제목 키워드 기반

Combining Data Generation and Active Learning for Low-Resource Question Answering

2022-11-27 · Maximilian Kimmich, Andrea Bartezzaghi, Jasmina Bogojeska, Cristiano Malossi 외

Neural approaches have become very popular in Question Answering (QA), however, they require a large amount of annotated data. In this work, we propose a novel approach that combines data augmentation via question-answer…

Active LearningAnswer GenerationData AugmentationQuestion-Answer-Generation+2

Unified Question Answering in Slovene

2022-11-16 · Katja Logar, Marko Robnik-Šikonja

Question answering is one of the most challenging tasks in language understanding. Most approaches are developed for English, while less-resourced languages are much less researched. We adapt a successful English questio…

Cross-Lingual TransferDecoderMultiple-choiceQuestion Answering

Mosaic Augmentation for Text: Cropping and Collaging as Cross-Domain Techniques

2022-01-16 · ACL ARR January 2022 1 · Anonymous

We present new visually inspired cropping and collaging data augmentations for text. We test how these augmentations impact data-scarce scenarios over multiple NLP tasks: name entity recognition, extractive question answ…

Abstractive Text SummarizationExtractive Question-AnsweringQuestion Answering

INDIC QA BENCHMARK: A Multilingual Benchmark to Evaluate Question Answering capability of LLMs for Indic Languages

2024-07-18 · Abhishek Kumar Singh, Rudra Murthy, Vishwajeet Kumar, Jaydeep Sen 외

Large Language Models (LLMs) have demonstrated remarkable zero-shot and few-shot capabilities in unseen tasks, including context-grounded question answering (QA) in English. However, the evaluation of LLMs' capabilities …

abstractive question answeringQuestion Answering

On the Summarization of Consumer Health Questions

2019-07-01 · ACL 2019 7 · Asma Ben Abacha, Dina Demner-Fushman

Question understanding is one of the main challenges in question answering. In real world applications, users often submit natural language questions that are longer than needed and include peripheral information that in…

Data AugmentationQuestion AnsweringRetrieval