Denoising Distantly Supervised Open-Domain Question Answering
Distantly supervised open-domain question answering (DS-QA) aims to find answers in collections of unlabeled text. Existing DS-QA models usually retrieve related paragraphs from a large-scale corpus and apply reading comprehension technique to extract answers from the most relevant paragraph. They ignore the rich information contained in other paragraphs. Moreover, distant supervision data inevitably accompanies with the wrong labeling problem, and these noisy data will substantially degrade the performance of DS-QA. To address these issues, we propose a novel DS-QA model which employs a paragraph selector to filter out those noisy paragraphs and a paragraph reader to extract the correct answer from those denoised paragraphs. Experimental results on real-world datasets show that our model can capture useful information from noisy data and achieve significant improvements on DS-QA as compared to all baselines.
Code (1)
Tasks
DenoisingInformation RetrievalOpen-Domain Question AnsweringQuestion AnsweringReading ComprehensionSimilar Papers 제목 키워드 기반
Denoise while Aggregating: Collaborative Learning in Open-Domain Question Answering
The open-domain question answering (OpenQA) task aims to extract answers that match specific questions from a distantly supervised corpus. Unlike supervised reading comprehension (RC) datasets where questions are designe…
Open-Domain Question AnsweringQuestion AnsweringReading ComprehensionSentenceCooperative Denoising for Distantly Supervised Relation Extraction
Distantly supervised relation extraction greatly reduces human efforts in extracting relational facts from unstructured texts. However, it suffers from noisy labeling problem, which can degrade its performance. Meanwhile…
DenoisingInformation RetrievalKnowledge DistillationQuestion Answering+2Improving Distantly-Supervised Named Entity Recognition with Self-Collaborative Denoising Learning
Distantly supervised named entity recognition (DS-NER) efficiently reduces labor costs but meanwhile intrinsically suffers from the label noise due to the strong assumption of distant supervision. Typically, the wrongly …
Denoisingnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1Few Clean Instances Help Denoising Distant Supervision
Existing distantly supervised relation extractors usually rely on noisy data for both model training and evaluation, which may lead to garbage-in-garbage-out systems. To alleviate the problem, we study whether a small cl…
DenoisingDistantly-Supervised Dense Retrieval Enables Open-Domain Question Answering without Evidence Annotation
Open-domain question answering answers a question based on evidence retrieved from a large corpus. State-of-the-art neural approaches require intermediate evidence annotations for training. However, such intermediate ann…
Open-Domain Question AnsweringQuestion AnsweringRetrieval