paper-with-me

Papers

Phrase Retrieval Learns Passage Retrieval, Too

2021-09-16 · EMNLP 2021 11 · Jinhyuk Lee, Alexander Wettig, Danqi Chen

Dense retrieval methods have shown great promise over sparse retrieval methods in a range of NLP problems. Among them, dense phrase retrieval-the most fine-grained retrieval unit-is appealing because phrases can be directly used as the output for question answering and slot filling tasks. In this work, we follow the intuition that retrieving phrases naturally entails retrieving larger text blocks and study whether phrase retrieval can serve as the basis for coarse-level retrieval including passages and documents. We first observe that a dense phrase-retrieval system, without any retraining, already achieves better passage retrieval accuracy (+3-5% in top-5 accuracy) compared to passage retrievers, which also helps achieve superior end-to-end QA performance with fewer passages. Then, we provide an interpretation for why phrase-level supervision helps learn better fine-grained entailment compared to passage-level supervision, and also show that phrase retrieval can be improved to achieve competitive performance in document-retrieval tasks such as entity linking and knowledge-grounded dialogue. Finally, we demonstrate how phrase filtering and vector quantization can reduce the size of our index by 4-10x, making dense phrase retrieval a practical and versatile solution in multi-granularity retrieval.

📄 PDF Abstract BibTeX arXiv:2109.08133

Code (1)

princeton-nlp/DensePhrases 공식 구현 pytorch

Tasks

Entity LinkingOpen-Domain Question AnsweringPassage RetrievalQuantizationQuestion AnsweringRetrievalslot-fillingSlot Filling

Similar Papers 제목 키워드 기반

Retrieval-Augmented Multilingual Keyphrase Generation with Retriever-Generator Iterative Training

2022-05-21 · Findings (NAACL) 2022 7 · Yifan Gao, Qingyu Yin, Zheng Li, Rui Meng 외

Keyphrase generation is the task of automatically predicting keyphrases given a piece of long text. Despite its recent flourishing, keyphrase generation on non-English languages haven't been vastly investigated. In this …

Keyphrase GenerationPassage RetrievalRetrieval

ConTextual Masked Auto-Encoder for Dense Passage Retrieval

2022-08-16 · Xing Wu, Guangyuan Ma, Meng Lin, Zijia Lin 외

Dense passage retrieval aims to retrieve the relevant passages of a query from a large corpus based on dense representations (i.e., vectors) of the query and the passages. Recent studies have explored improving pre-train…

DecoderPassage RetrievalRetrievalSentence

A Neural Passage Model for Ad-hoc Document Retrieval

2021-03-16 · Qingyao Ai, Brendan O Connor, W. Bruce Croft

Traditional statistical retrieval models often treat each document as a whole. In many cases, however, a document is relevant to a query only because a small part of it contain the targeted information. In this work, we …

Document RankingRetrieval

Optimizing Test-Time Query Representations for Dense Retrieval

2022-05-25 · Mujeen Sung, Jungsoo Park, Jaewoo Kang, Danqi Chen 외

Recent developments of dense retrieval rely on quality representations of queries and contexts from pre-trained query and context encoders. In this paper, we introduce TOUR (Test-Time Optimization of Query Representation…

Contrastive LearningInformation RetrievalOpen-Domain Question AnsweringPassage Retrieval+3

DuReader_retrieval: A Large-scale Chinese Benchmark for Passage Retrieval from Web Search Engine

2022-03-19 · Yifu Qiu, Hongyu Li, Yingqi Qu, Ying Chen 외

In this paper, we present DuReader_retrieval, a large-scale Chinese dataset for passage retrieval. DuReader_retrieval contains more than 90K queries and over 8M unique passages from a commercial search engine. To allevia…

Domain GeneralizationPassage RetrievalRetrieval