Passage Ranking with Weak Supervision
In this paper, we propose a \textit{weak supervision} framework for neural ranking tasks based on the data programming paradigm \citep{Ratner2016}, which enables us to leverage multiple weak supervision signals from different sources. Empirically, we consider two sources of weak supervision signals, unsupervised ranking functions and semantic feature similarities. We train a BERT-based passage-ranking model (which achieves new state-of-the-art performances on two benchmark datasets with full supervision) in our weak supervision framework. Without using ground-truth training labels, BERT-PR models outperform BM25 baseline by a large margin on all three datasets and even beat the previous state-of-the-art results with full supervision on two of the datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Passage RankingSimilar Papers 제목 키워드 기반
Generalized Weak Supervision for Neural Information Retrieval
Neural ranking models (NRMs) have demonstrated effective performance in several information retrieval (IR) tasks. However, training NRMs often requires large-scale training data, which is difficult and expensive to obtai…
Information RetrievalPassage RetrievalRetrievalMaking Information Seeking Easier: An Improved Pipeline for Conversational Search
This paper presents a highly effective pipeline for passage retrieval in a conversational search setting. The pipeline comprises of two components: Conversational Term Selection (CTS) and Multi-View Reranking (MVR). CTS …
Conversational SearchPassage RankingPassage RerankingPassage Retrieval+2An In-depth Analysis of Passage-Level Label Transfer for Contextual Document Ranking
Pre-trained contextual language models such as BERT, GPT, and XLnet work quite well for document retrieval tasks. Such models are fine-tuned based on the query-document/query-passage level relevance labels to capture the…
Document RankingRetrievalWeakly-Supervised Open-Retrieval Conversational Question Answering
Recent studies on Question Answering (QA) and Conversational QA (ConvQA) emphasize the role of retrieval: a system first retrieves evidence from a large collection and then extracts answers. This open-retrieval ConvQA se…
Conversational Question AnsweringQuestion AnsweringRetrievalPReGAN: Answer Oriented Passage Ranking with Weakly Supervised GAN
Beyond topical relevance, passage ranking for open-domain factoid question answering also requires a passage to contain an answer (answerability). While a few recent studies have incorporated some reading capability into…
Passage RankingPassage RerankingQuestion AnsweringReranking