Denoise while Aggregating: Collaborative Learning in Open-Domain Question Answering
The open-domain question answering (OpenQA) task aims to extract answers that match specific questions from a distantly supervised corpus. Unlike supervised reading comprehension (RC) datasets where questions are designed for particular paragraphs, background sentences in OpenQA datasets are more prone to noise. We observe that most existing OpenQA approaches are vulnerable to noise since they simply regard those sentences that contain the answer span as ground truths and ignore the plausible correlation between the sentences and the question. To address this deficiency, we introduce a unified and collaborative model that leverages alignment information from query-sentence pairs in a small-scale supervised RC dataset and aggregates relevant evidence from distantly supervised corpus to answer open-domain questions. We evaluate our model on several real-world OpenQA datasets, and experimental results show that our collaborative learning methods outperform the existing baselines significantly.
Code (0)
등록된 구현이 없습니다.
Tasks
Open-Domain Question AnsweringQuestion AnsweringReading ComprehensionSentenceSimilar Papers 제목 키워드 기반
Zero-shot denoising via neural compression: Theoretical and algorithmic framework
Zero-shot denoising aims to denoise observations without access to training samples or clean reference images. This setting is particularly relevant in practical imaging scenarios involving specialized domains such as me…
DenoisingOpenSeeker: Democratizing Frontier Search Agents by Fully Open-Sourcing Training Data
Deep search capabilities have become an indispensable competency for frontier Large Language Model (LLM) agents, yet the development of high-performance search agents remains dominated by industrial giants due to a lack …
Achieving the time of $1$-NN, but the accuracy of $k$-NN
We propose a simple approach which, given distributed computing resources, can nearly achieve the accuracy of $k$-NN prediction, while matching (or improving) the faster prediction time of $1$-NN. The approach consists o…
Computational EfficiencyDistributed ComputingPredictionOn Decentralizing Federated Reinforcement Learning in Multi-Robot Scenarios
Federated Learning (FL) allows for collaboratively aggregating learned information across several computing devices and sharing the same amongst them, thereby tackling issues of privacy and the need of huge bandwidth. FL…
Federated LearningQ-Learningreinforcement-learningReinforcement Learning+1Dual-domain Collaborative Denoising for Social Recommendation
Social recommendation leverages social network to complement user-item interaction data for recommendation task, aiming to mitigate the data sparsity issue in recommender systems. However, existing social recommendation …
Contrastive LearningDenoisingRecommendation Systems