A Neural Passage Model for Ad-hoc Document Retrieval
Traditional statistical retrieval models often treat each document as a whole. In many cases, however, a document is relevant to a query only because a small part of it contain the targeted information. In this work, we propose a neural passage model (NPM) that uses passage-level information to improve the performance of ad-hoc retrieval. Instead of using a single window to extract passages, our model automatically learns to weight passages with different granularities in the training process. We show that the passage-based document ranking paradigm from previous studies can be directly derived from our neural framework. Also, our experiments on a TREC collection showed that the NPM can significantly outperform the existing passage-based retrieval models.
Code (0)
등록된 구현이 없습니다.
Tasks
Document RankingRetrievalSimilar Papers 제목 키워드 기반
A Passage-Based Approach to Learning to Rank Documents
According to common relevance-judgments regimes, such as TREC's, a document can be deemed relevant to a query even if it contains a very short passage of text with pertinent information. This fact has motivated work on p…
Document RankingLearning-To-RankPassage RankingRetrievalDAPR: A Benchmark on Document-Aware Passage Retrieval
The work of neural retrieval so far focuses on ranking short texts and is challenged with long documents. There are many cases where the users want to find a relevant passage within a long document from a huge corpus, e.…
ArticlesPassage RetrievalRetrievalDense Hierarchical Retrieval for Open-Domain Question Answering
Dense neural text retrieval has achieved promising results on open-domain Question Answering (QA), where latent representations of questions and passages are exploited for maximum inner product search in the retrieval pr…
Open-Domain Question AnsweringQuestion AnsweringRetrievalText RetrievalAn In-depth Analysis of Passage-Level Label Transfer for Contextual Document Ranking
Pre-trained contextual language models such as BERT, GPT, and XLnet work quite well for document retrieval tasks. Such models are fine-tuned based on the query-document/query-passage level relevance labels to capture the…
Document RankingRetrievalA Method of Passage-Based Document Retrieval in Question Answering System
We propose a method for using the scoring values of passages to effectively retrieve documents in a Question Answering system. For this, we suggest evaluation function that considers proximity between each question ter…
Question AnsweringRetrieval