Modeling Diverse Relevance Patterns in Ad-hoc Retrieval
Assessing relevance between a query and a document is challenging in ad-hoc retrieval due to its diverse patterns, i.e., a document could be relevant to a query as a whole or partially as long as it provides sufficient information for users' need. Such diverse relevance patterns require an ideal retrieval model to be able to assess relevance in the right granularity adaptively. Unfortunately, most existing retrieval models compute relevance at a single granularity, either document-wide or passage-level, or use fixed combination strategy, restricting their ability in capturing diverse relevance patterns. In this work, we propose a data-driven method to allow relevance signals at different granularities to compete with each other for final relevance assessment. Specifically, we propose a HIerarchical Neural maTching model (HiNT) which consists of two stacked components, namely local matching layer and global decision layer. The local matching layer focuses on producing a set of local relevance signals by modeling the semantic matching between a query and each passage of a document. The global decision layer accumulates local signals into different granularities and allows them to compete with each other to decide the final relevance score. Experimental results demonstrate that our HiNT model outperforms existing state-of-the-art retrieval models significantly on benchmark ad-hoc retrieval datasets.
Code (2)
Tasks
RetrievalSimilar Papers 제목 키워드 기반
Cross-Lingual Relevance Transfer for Document Retrieval
Recent work has shown the surprising ability of multi-lingual BERT to serve as a zero-shot cross-lingual transfer model for a number of language processing tasks. We combine this finding with a similarly-recently proposa…
Cross-Lingual TransferRetrievalSentenceZero-Shot Cross-Lingual TransferUncovering the Bigger Picture: Comprehensive Event Understanding Via Diverse News Retrieval
Access to diverse perspectives is essential for understanding real-world events, yet most news retrieval systems prioritize textual relevance, leading to redundant results and limited viewpoint exposure. We propose NEWSC…
A Linguistic Study on Relevance Modeling in Information Retrieval
Relevance plays a central role in information retrieval (IR), which has received extensive studies starting from the 20th century. The definition and the modeling of relevance has always been critical challenges in both …
Information RetrievalNatural Language UnderstandingQuestion AnsweringRetrievalCAME: Competitively Learning a Mixture-of-Experts Model for First-stage Retrieval
The first-stage retrieval aims to retrieve a subset of candidate documents from a huge collection both effectively and efficiently. Since various matching patterns can exist between queries and relevant documents, previo…
Mixture-of-ExpertsRetrievalGRM: Generative Relevance Modeling Using Relevance-Aware Sample Estimation for Document Retrieval
Recent studies show that Generative Relevance Feedback (GRF), using text generated by Large Language Models (LLMs), can enhance the effectiveness of query expansion. However, LLMs can generate irrelevant information that…
Document RankingRetrieval