End-to-End Neural Ad-hoc Ranking with Kernel Pooling
This paper proposes K-NRM, a kernel based neural model for document ranking. Given a query and a set of documents, K-NRM uses a translation matrix that models word-level similarities via word embeddings, a new kernel-pooling technique that uses kernels to extract multi-level soft match features, and a learning-to-rank layer that combines those features into the final ranking score. The whole model is trained end-to-end. The ranking layer learns desired feature patterns from the pairwise ranking loss. The kernels transfer the feature patterns into soft-match targets at each similarity level and enforce them on the translation matrix. The word embeddings are tuned accordingly so that they can produce the desired soft matches. Experiments on a commercial search engine's query log demonstrate the improvements of K-NRM over prior feature-based and neural-based states-of-the-art, and explain the source of K-NRM's advantage: Its kernel-guided embedding encodes a similarity metric tailored for matching query words to document words, and provides effective multi-level soft matches.
Code (1)
Tasks
Ad-Hoc Information RetrievalDocument RankingLearning-To-RankTranslationWord EmbeddingsSimilar Papers 제목 키워드 기반
TU Wien @ TREC Deep Learning '19 -- Simple Contextualization for Re-ranking
The usage of neural network models puts multiple objectives in conflict with each other: Ideally we would like to create a neural model that is effective, efficient, and interpretable at the same time. However, in most i…
Deep LearningDocument RankingPassage RankingRe-Ranking+1Convolutional Neural Networks for Soft Matching N-Grams in Ad-hoc Search
This paper presents Conv-KNRM, a Convolutional Kernel-based Neural Ranking Model that models n-gram soft matches for ad-hoc search. Instead of exact matching query and document n-grams, Conv-KNRM uses Convolutional Neura…
Learning-To-RankInterpretable & Time-Budget-Constrained Contextualization for Re-Ranking
Search engines operate under a strict time constraint as a fast response is paramount to user satisfaction. Thus, neural re-ranking models have a limited time-budget to re-rank documents. Given the same amount of time, a…
Re-RankingWord EmbeddingsStacked Pooling: Improving Crowd Counting by Boosting Scale Invariance
In this work, we explore the cross-scale similarity in crowd counting scenario, in which the regions of different scales often exhibit high visual similarity. This feature is universal both within an image and across dif…
Crowd CountingDensity EstimationTopology-Aware Pooling via Graph Attention
Pooling operations have shown to be effective on various tasks in computer vision and natural language processing. One challenge of performing pooling operations on graph data is the lack of locality that is not well-def…
Graph AttentionGraph Classification