Text Retrieval with Multi-Stage Re-Ranking Models
The text retrieval is the task of retrieving similar documents to a search query, and it is important to improve retrieval accuracy while maintaining a certain level of retrieval speed. Existing studies have reported accuracy improvements using language models, but many of these do not take into account the reduction in search speed that comes with increased performance. In this study, we propose three-stage re-ranking model using model ensembles or larger language models to improve search accuracy while minimizing the search delay. We ranked the documents by BM25 and language models, and then re-ranks by a model ensemble or a larger language model for documents with high similarity to the query. In our experiments, we train the MiniLM language model on the MS-MARCO dataset and evaluate it in a zero-shot setting. Our proposed method achieves higher retrieval accuracy while reducing the retrieval speed decay.
Code (1)
Tasks
Language ModelingLanguage ModellingRe-RankingRetrievalText RetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
HLATR: Enhance Multi-stage Text Retrieval with Hybrid List Aware Transformer Reranking
Deep pre-trained language models (e,g. BERT) are effective at large-scale text retrieval task. Existing text retrieval systems with state-of-the-art performance usually adopt a retrieve-then-reranking architecture due to…
Passage RankingPassage Re-RankingRerankingRetrieval+1Hybrid Retrieval and Multi-stage Text Ranking Solution at TREC 2022 Deep Learning Track
Large-scale text retrieval technology has been widely used in various practical business scenarios. This paper presents our systems for the TREC 2022 Deep Learning Track. We explain the hybrid text retrieval and multi-st…
Document RankingLanguage ModelingLanguage ModellingPassage Ranking+2RANKVIDEO: Reasoning Reranking for Text-to-Video Retrieval
Reranking is a critical component of modern retrieval systems, which typically pair an efficient first-stage retriever with a more expressive model to refine results. While large reasoning models have driven rapid progre…
Video RetrievalCFIR: Fast and Effective Long-Text To Image Retrieval for Large Corpora
Text-to-image retrieval aims to find the relevant images based on a text query, which is important in various use-cases, such as digital libraries, e-commerce, and multimedia databases. Although Multimodal Large Language…
Computational EfficiencyImage RetrievalRe-RankingRetrievalLLM-Based Compact Reranking with Document Features for Scientific Retrieval
Scientific retrieval is essential for advancing academic discovery. Within this process, document reranking plays a critical role by refining first-stage retrieval results. However, large language model (LLM) listwise re…
Large Language ModelRerankingRetrieval