paper-with-me

Papers

A Few Brief Notes on DeepImpact, COIL, and a Conceptual Framework for Information Retrieval Techniques

2021-06-28 · Jimmy Lin, Xueguang Ma

Recent developments in representational learning for information retrieval can be organized in a conceptual framework that establishes two pairs of contrasts: sparse vs. dense representations and unsupervised vs. learned representations. Sparse learned representations can further be decomposed into expansion and term weighting components. This framework allows us to understand the relationship between recently proposed techniques such as DPR, ANCE, DeepCT, DeepImpact, and COIL, and furthermore, gaps revealed by our analysis point to "low hanging fruit" in terms of techniques that have yet to be explored. We present a novel technique dubbed "uniCOIL", a simple extension of COIL that achieves to our knowledge the current state-of-the-art in sparse retrieval on the popular MS MARCO passage ranking dataset. Our implementation using the Anserini IR toolkit is built on the Lucene search library and thus fully compatible with standard inverted indexes.

📄 PDF Abstract BibTeX arXiv:2106.14807

Code (0)

등록된 구현이 없습니다.

Tasks

Information RetrievalPassage RankingRetrieval

Similar Papers 제목 키워드 기반

Sparsifying Sparse Representations for Passage Retrieval by Top-$k$ Masking

2021-12-17 · Jheng-Hong Yang, Xueguang Ma, Jimmy Lin

Sparse lexical representation learning has demonstrated much progress in improving passage retrieval effectiveness in recent models such as DeepImpact, uniCOIL, and SPLADE. This paper describes a straightforward yet effe…

Passage RetrievalRepresentation LearningRetrievalSelf-Learning

Learning Passage Impacts for Inverted Indexes

2021-04-24 · Antonio Mallia, Omar Khattab, Nicola Tonellotto, Torsten Suel

Neural information retrieval systems typically use a cascading pipeline, in which a first-stage model retrieves a candidate set of documents and one or more subsequent stages re-rank this set using contextualized languag…

Information RetrievalLanguage ModelingLanguage ModellingRe-Ranking+1

A hierarchical neural stimulation model for pain relief by variation of coil design parameters

2016-09-13

Neural stimulation represents a powerful technique for neural disorder treatment. This paper deals with optimization of coil design parameters to be used during stimulation for modulation of neuronal firing to achieve pa…

Optimizing Guided Traversal for Fast Learned Sparse Retrieval

2023-05-02 · Yifan Qiao, Yingrui Yang, Haixin Lin, Tao Yang

Recent studies show that BM25-driven dynamic index skipping can greatly accelerate MaxScore-based document retrieval based on the learned sparse representation derived by DeepImpact. This paper investigates the effective…

Retrieval

A Static Pruning Study on Sparse Neural Retrievers

2023-04-25 · Carlos Lassance, Simon Lupart, Hervé Dejean, Stéphane Clinchant 외

Sparse neural retrievers, such as DeepImpact, uniCOIL and SPLADE, have been introduced recently as an efficient and effective way to perform retrieval with inverted indexes. They aim to learn term importance and, in some…

Document RankingRetrieval