paper-with-me

홈 › Papers

End-to-End Neural Ad-hoc Ranking with Kernel Pooling

2017-06-20 · Chenyan Xiong, Zhuyun Dai, Jamie Callan, Zhiyuan Liu, Russell Power

This paper proposes K-NRM, a kernel based neural model for document ranking. Given a query and a set of documents, K-NRM uses a translation matrix that models word-level similarities via word embeddings, a new kernel-pooling technique that uses kernels to extract multi-level soft match features, and a learning-to-rank layer that combines those features into the final ranking score. The whole model is trained end-to-end. The ranking layer learns desired feature patterns from the pairwise ranking loss. The kernels transfer the feature patterns into soft-match targets at each similarity level and enforce them on the translation matrix. The word embeddings are tuned accordingly so that they can produce the desired soft matches. Experiments on a commercial search engine's query log demonstrate the improvements of K-NRM over prior feature-based and neural-based states-of-the-art, and explain the source of K-NRM's advantage: Its kernel-guided embedding encodes a similarity metric tailored for matching query words to document words, and provides effective multi-level soft matches.

📄 PDF Abstract BibTeX arXiv:1706.06613

Code (1)

AdeDZY/K-NRM tf

Tasks

Ad-Hoc Information RetrievalDocument RankingLearning-To-RankTranslationWord Embeddings

Similar Papers 제목 키워드 기반

TU Wien @ TREC Deep Learning '19 -- Simple Contextualization for Re-ranking

2019-12-03 · Sebastian Hofstätter, Markus Zlabinger, Allan Hanbury

The usage of neural network models puts multiple objectives in conflict with each other: Ideally we would like to create a neural model that is effective, efficient, and interpretable at the same time. However, in most i…

Deep LearningDocument RankingPassage RankingRe-Ranking+1

Convolutional Neural Networks for Soft Matching N-Grams in Ad-hoc Search

2018-02-02 · WSDM 2018 2018 2 · Zhuyun Dai, Chenyan Xiong, Jamie Callan, Zhiyuan Liu

This paper presents Conv-KNRM, a Convolutional Kernel-based Neural Ranking Model that models n-gram soft matches for ad-hoc search. Instead of exact matching query and document n-grams, Conv-KNRM uses Convolutional Neura…

Learning-To-Rank

Interpretable & Time-Budget-Constrained Contextualization for Re-Ranking

2020-02-04 · Sebastian Hofstätter, Markus Zlabinger, Allan Hanbury

Search engines operate under a strict time constraint as a fast response is paramount to user satisfaction. Thus, neural re-ranking models have a limited time-budget to re-rank documents. Given the same amount of time, a…

Re-RankingWord Embeddings

Stacked Pooling: Improving Crowd Counting by Boosting Scale Invariance

2018-08-22 · Siyu Huang, Xi Li, Zhi-Qi Cheng, Zhongfei Zhang 외

In this work, we explore the cross-scale similarity in crowd counting scenario, in which the regions of different scales often exhibit high visual similarity. This feature is universal both within an image and across dif…

Crowd CountingDensity Estimation

Topology-Aware Pooling via Graph Attention

2019-09-25 · Hongyang Gao, Shuiwang Ji

Pooling operations have shown to be effective on various tasks in computer vision and natural language processing. One challenge of performing pooling operations on graph data is the lack of locality that is not well-def…

Graph AttentionGraph Classification