paper-with-me

홈 › Papers

Dense Retrieval with Continuous Explicit Feedback for Systematic Review Screening Prioritisation

2024-06-30 · Xinyu Mao, Shengyao Zhuang, Bevan Koopman, Guido Zuccon

The goal of screening prioritisation in systematic reviews is to identify relevant documents with high recall and rank them in early positions for review. This saves reviewing effort if paired with a stopping criterion, and speeds up review completion if performed alongside downstream tasks. Recent studies have shown that neural models have good potential on this task, but their time-consuming fine-tuning and inference discourage their widespread use for screening prioritisation. In this paper, we propose an alternative approach that still relies on neural models, but leverages dense representations and relevance feedback to enhance screening prioritisation, without the need for costly model fine-tuning and inference. This method exploits continuous relevance feedback from reviewers during document screening to efficiently update the dense query representation, which is then applied to rank the remaining documents to be screened. We evaluate this approach across the CLEF TAR datasets for this task. Results suggest that the investigated dense query-driven approach is more efficient than directly using neural models and shows promising effectiveness compared to previous methods developed on the considered datasets. Our code is available at https://github.com/ielab/dense-screening-feedback.

📄 PDF Abstract BibTeX arXiv:2407.00635

Code (1)

ielab/dense-screening-feedback 공식 구현

Tasks

RetrievalTAR

Similar Papers 제목 키워드 기반

DenseReviewer: A Screening Prioritisation Tool for Systematic Review based on Dense Retrieval

2025-02-05 · Xinyu Mao, Teerapong Leelanupab, Harrisen Scells, Guido Zuccon

Screening is a time-consuming and labour-intensive yet required task for medical systematic reviews, as tens of thousands of studies often need to be screened. Prioritising relevant studies to be screened allows downstre…

Active Learning

Pseudo-Relevance Feedback for Multiple Representation Dense Retrieval

2021-06-21 · Xiao Wang, Craig Macdonald, Nicola Tonellotto, Iadh Ounis

Pseudo-relevance feedback mechanisms, from Rocchio to the relevance models, have shown the usefulness of expanding and reweighting the users' initial queries using information occurring in an initial set of retrieved doc…

Information RetrievalPassage RankingRerankingRetrieval+1

Towards Consistency Filtering-Free Unsupervised Learning for Dense Retrieval

2023-08-05 · Haoxiang Shi, Sumio Fujita, Tetsuya Sakai

Domain transfer is a prevalent challenge in modern neural Information Retrieval (IR). To overcome this problem, previous research has utilized domain-specific manual annotations and synthetic data produced by consistency…

Information RetrievalRetrieval

Optimizing Test-Time Query Representations for Dense Retrieval

2022-05-25 · Mujeen Sung, Jungsoo Park, Jaewoo Kang, Danqi Chen 외

Recent developments of dense retrieval rely on quality representations of queries and contexts from pre-trained query and context encoders. In this paper, we introduce TOUR (Test-Time Optimization of Query Representation…

Contrastive LearningInformation RetrievalOpen-Domain Question AnsweringPassage Retrieval+3

Improving Query Representations for Dense Retrieval with Pseudo Relevance Feedback

2021-08-30 · HongChien Yu, Chenyan Xiong, Jamie Callan

Dense retrieval systems conduct first-stage retrieval using embedded representations and simple similarity metrics to match a query to documents. Its effectiveness depends on encoded embeddings to capture the semantics o…

Retrieval