paper-with-me

홈 › Papers

Towards Consistency Filtering-Free Unsupervised Learning for Dense Retrieval

2023-08-05 · Haoxiang Shi, Sumio Fujita, Tetsuya Sakai

Domain transfer is a prevalent challenge in modern neural Information Retrieval (IR). To overcome this problem, previous research has utilized domain-specific manual annotations and synthetic data produced by consistency filtering to finetune a general ranker and produce a domain-specific ranker. However, training such consistency filters are computationally expensive, which significantly reduces the model efficiency. In addition, consistency filtering often struggles to identify retrieval intentions and recognize query and corpus distributions in a target domain. In this study, we evaluate a more efficient solution: replacing the consistency filter with either direct pseudo-labeling, pseudo-relevance feedback, or unsupervised keyword generation methods for achieving consistent filtering-free unsupervised dense retrieval. Our extensive experimental evaluations demonstrate that, on average, TextRank-based pseudo relevance feedback outperforms other methods. Furthermore, we analyzed the training and inference efficiency of the proposed paradigm. The results indicate that filtering-free unsupervised learning can continuously improve training and inference efficiency while maintaining retrieval performance. In some cases, it can even improve performance based on particular datasets.

📄 PDF Abstract BibTeX arXiv:2308.02926

Code (0)

등록된 구현이 없습니다.

Tasks

Information RetrievalRetrieval

Similar Papers 제목 키워드 기반

Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrieval

2021-08-12 · ACL 2022 5 · Luyu Gao, Jamie Callan

Recent research demonstrates the effectiveness of using fine-tuned language models~(LM) for dense retrieval. However, dense retrievers are hard to train, typically requiring heavily engineered fine-tuning pipelines to re…

Language ModelingLanguage ModellingPassage RetrievalRetrieval

Unsupervised Dense Retrieval Training with Web Anchors

2023-05-10 · Yiqing Xie, Xiao Liu, Chenyan Xiong

In this work, we present an unsupervised retrieval method with contrastive learning on web anchors. The anchor text describes the content that is referenced from the linked page. This shows similarities to search queries…

Contrastive LearningQuestion AnsweringRetrieval

ReGen: Zero-Shot Text Classification via Training Data Generation with Progressive Dense Retrieval

2023-05-18 · Yue Yu, Yuchen Zhuang, Rongzhi Zhang, Yu Meng 외

With the development of large language models (LLMs), zero-shot learning has attracted much attention for various NLP tasks. Different from prior works that generate training data with billion-scale natural language gene…

DescriptiveRetrievaltext-classificationText Classification+4

AugTriever: Unsupervised Dense Retrieval and Domain Adaptation by Scalable Data Augmentation

2022-12-17 · Rui Meng, Ye Liu, Semih Yavuz, Divyansh Agarwal 외

Dense retrievers have made significant strides in text retrieval and open-domain question answering. However, most of these achievements have relied heavily on extensive human-annotated supervision. In this study, we aim…

Data AugmentationDomain AdaptationOpen-Domain Question AnsweringQuestion Answering+3

Precise Zero-Shot Dense Retrieval without Relevance Labels

2022-12-20 · Luyu Gao, Xueguang Ma, Jimmy Lin, Jamie Callan

While dense retrieval has been shown effective and efficient across tasks and languages, it remains difficult to create effective fully zero-shot dense retrieval systems when no relevance label is available. In this pape…

Fact VerificationInstruction FollowingLanguage ModelingLanguage Modelling+2