Revisiting Iterative Relevance Feedback for Document and Passage Retrieval
As more and more search traffic comes from mobile phones, intelligent assistants, and smart-home devices, new challenges (e.g., limited presentation space) and opportunities come up in information retrieval. Previously, an effective technique, relevance feedback (RF), has rarely been used in real search scenarios due to the overhead of collecting users' relevance judgments. However, since users tend to interact more with the search results shown on the new interfaces, it becomes feasible to obtain users' assessments on a few results during each interaction. This makes iterative relevance feedback (IRF) techniques look promising today. IRF has not been studied systematically in the new search scenarios and its effectiveness is mostly unknown. In this paper, we re-visit IRF and extend it with RF models proposed in recent years. We conduct extensive experiments to analyze and compare IRF with the standard top-k RF framework on document and passage retrieval. Experimental results show that IRF is at least as effective as the standard top-k RF framework for documents and much more effective for passages. This indicates that IRF for passage retrieval has huge potential.
Code (0)
등록된 구현이 없습니다.
Tasks
Information RetrievalPassage RetrievalRetrievalSimilar Papers 제목 키워드 기반
Iterative Relevance Feedback for Answer Passage Retrieval with Passage-level Semantic Match
Relevance feedback techniques assume that users provide relevance judgments for the top k (usually 10) documents and then re-rank using a new query model based on those judgments. Even though this is effective, there has…
Passage RetrievalRetrievalSemantic SimilaritySemantic Textual SimilarityMining Implicit Relevance Feedback from User Behavior for Web Question Answering
Training and refreshing a web-scale Question Answering (QA) system for a multi-lingual commercial search engine often requires a huge amount of training examples. One principled idea is to mine implicit relevance feedbac…
Passage RankingQuestion AnsweringADORE: Iterative Query Expansion with Retrieval-Grounded Relevance Feedback
LLM-based query expansion improves retrieval by enriching the original query with additional context. Yet most methods remain generation-driven, producing plausible pseudo-documents or expansions without checking how the…
Pseudo-Relevance Feedback for Multiple Representation Dense Retrieval
Pseudo-relevance feedback mechanisms, from Rocchio to the relevance models, have shown the usefulness of expanding and reweighting the users' initial queries using information occurring in an initial set of retrieved doc…
Information RetrievalPassage RankingRerankingRetrieval+1Pseudo-Relevance Feedback Can Improve Zero-Shot LLM-Based Dense Retrieval
Pseudo-relevance feedback (PRF) refines queries by leveraging initially retrieved documents to improve retrieval effectiveness. In this paper, we investigate how large language models (LLMs) can facilitate PRF for zero-s…
Passage RetrievalRetrieval