paper-with-me

홈 › Papers

A Graph-based Relevance Matching Model for Ad-hoc Retrieval

2021-01-28 · Yufeng Zhang, Jinghao Zhang, Zeyu Cui, Shu Wu, Liang Wang

To retrieve more relevant, appropriate and useful documents given a query, finding clues about that query through the text is crucial. Recent deep learning models regard the task as a term-level matching problem, which seeks exact or similar query patterns in the document. However, we argue that they are inherently based on local interactions and do not generalise to ubiquitous, non-consecutive contextual relationships. In this work, we propose a novel relevance matching model based on graph neural networks to leverage the document-level word relationships for ad-hoc retrieval. In addition to the local interactions, we explicitly incorporate all contexts of a term through the graph-of-word text format. Matching patterns can be revealed accordingly to provide a more accurate relevance score. Our approach significantly outperforms strong baselines on two ad-hoc benchmarks. We also experimentally compare our model with BERT and show our advantages on long documents.

📄 PDF Abstract BibTeX arXiv:2101.11873

Code (1)

CRIPAC-DIG/GRMM 공식 구현 pytorch

Tasks

Retrieval

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Weight Decay 설명 없음
WordPiece 설명 없음
Residual Connection 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Graph-based Hierarchical Relevance Matching Signals for Ad-hoc Retrieval

2021-02-22 · Xueli Yu, Weizhi Xu, Zeyu Cui, Shu Wu 외

The ad-hoc retrieval task is to rank related documents given a query and a document collection. A series of deep learning based approaches have been proposed to solve such problem and gained lots of attention. However, w…

Retrieval

A Deep Relevance Matching Model for Ad-hoc Retrieval

2017-11-23 · Jiafeng Guo, Yixing Fan, Qingyao Ai, W. Bruce Croft

In recent years, deep neural networks have led to exciting breakthroughs in speech recognition, computer vision, and natural language processing (NLP) tasks. However, there have been few positive results of deep models o…

Ad-Hoc Information RetrievalParaphrase IdentificationQuestion AnsweringRetrieval+2

Modeling Diverse Relevance Patterns in Ad-hoc Retrieval

2018-05-15 · SIGIR '18 2018 5 · Yixing Fan, Jiafeng Guo, Yanyan Lan, Jun Xu 외

Assessing relevance between a query and a document is challenging in ad-hoc retrieval due to its diverse patterns, i.e., a document could be relevant to a query as a whole or partially as long as it provides sufficient i…

Retrieval

Multiresolution Graph Attention Networks for Relevance Matching

2019-02-27 · Ting Zhang, Bang Liu, Di Niu, Kunfeng Lai 외

A large number of deep learning models have been proposed for the text matching problem, which is at the core of various typical natural language processing (NLP) tasks. However, existing deep models are mainly designed …

Graph AttentionInformation RetrievalParaphrase IdentificationQuestion Answering+2

Deep Uncertainty-Based Explore for Index Construction and Retrieval in Recommendation System

2024-07-22 · Xin Jiang, Kaiqiang Wang, Yinlong Wang, Fengchang Lv 외

In recommendation systems, the relevance and novelty of the final results are selected through a cascade system of Matching -> Ranking -> Strategy. The matching model serves as the starting point of the pipeline and dete…

Recommendation SystemsRetrieval