paper-with-me

Papers

Densifying Sparse Representations for Passage Retrieval by Representational Slicing

2021-12-09 · Sheng-Chieh Lin, Jimmy Lin

Learned sparse and dense representations capture different successful approaches to text retrieval and the fusion of their results has proven to be more effective and robust. Prior work combines dense and sparse retrievers by fusing their model scores. As an alternative, this paper presents a simple approach to densifying sparse representations for text retrieval that does not involve any training. Our densified sparse representations (DSRs) are interpretable and can be easily combined with dense representations for end-to-end retrieval. We demonstrate that our approach can jointly learn sparse and dense representations within a single model and then combine them for dense retrieval. Experimental results suggest that combining our DSRs and dense representations yields a balanced tradeoff between effectiveness and efficiency.

📄 PDF Abstract BibTeX arXiv:2112.04666

Code (1)

castorini/dhr jax

Tasks

Passage RetrievalRetrievalText Retrieval

Similar Papers 제목 키워드 기반

A Few Brief Notes on DeepImpact, COIL, and a Conceptual Framework for Information Retrieval Techniques

2021-06-28 · Jimmy Lin, Xueguang Ma

Recent developments in representational learning for information retrieval can be organized in a conceptual framework that establishes two pairs of contrasts: sparse vs. dense representations and unsupervised vs. learned…

Information RetrievalPassage RankingRetrieval

Sparsifying Sparse Representations for Passage Retrieval by Top-$k$ Masking

2021-12-17 · Jheng-Hong Yang, Xueguang Ma, Jimmy Lin

Sparse lexical representation learning has demonstrated much progress in improving passage retrieval effectiveness in recent models such as DeepImpact, uniCOIL, and SPLADE. This paper describes a straightforward yet effe…

Passage RetrievalRepresentation LearningRetrievalSelf-Learning

GNN-encoder: Learning a Dual-encoder Architecture via Graph Neural Networks for Dense Passage Retrieval

2022-04-18 · Jiduan Liu, Jiahao Liu, Yang Yang, Jingang Wang 외

Recently, retrieval models based on dense representations are dominant in passage retrieval tasks, due to their outstanding ability in terms of capturing semantics of input text compared to the traditional sparse vector …

Natural QuestionsPassage RetrievalRetrievalTriviaQA

Dense Passage Retrieval for Open-Domain Question Answering

2020-04-10 · EMNLP 2020 11 · Vladimir Karpukhin, Barlas Oğuz, Sewon Min, Patrick Lewis 외

Open-domain question answering relies on efficient passage retrieval to select candidate contexts, where traditional sparse vector space models, such as TF-IDF or BM25, are the de facto method. In this work, we show that…

Open-Domain Question AnsweringPassage RetrievalQuestion AnsweringRetrieval

MIA 2022 Shared Task Submission: Leveraging Entity Representations, Dense-Sparse Hybrids, and Fusion-in-Decoder for Cross-Lingual Question Answering

2022-07-05 · NAACL (MIA) 2022 7 · Zhucheng Tu, Sarguna Janani Padmanabhan

We describe our two-stage system for the Multilingual Information Access (MIA) 2022 Shared Task on Cross-Lingual Open-Retrieval Question Answering. The first stage consists of multilingual passage retrieval with a hybrid…

Cross-Lingual Question AnsweringDecoderLanguage ModelingLanguage Modelling+3