Establishing Strong Baselines for TripClick Health Retrieval
We present strong Transformer-based re-ranking and dense retrieval baselines for the recently released TripClick health ad-hoc retrieval collection. We improve the - originally too noisy - training data with a simple negative sampling policy. We achieve large gains over BM25 in the re-ranking task of TripClick, which were not achieved with the original baselines. Furthermore, we study the impact of different domain-specific pre-trained models on TripClick. Finally, we show that dense retrieval outperforms BM25 by considerable margins, even with simple training procedures.
Code (2)
Tasks
Re-RankingRetrievalSimilar Papers 제목 키워드 기반
TripJudge: A Relevance Judgement Test Collection for TripClick Health Retrieval
Robust test collections are crucial for Information Retrieval research. Recently there is a growing interest in evaluating retrieval systems for domain-specific retrieval tasks, however these tasks often lack a reliable …
Information RetrievalRetrievalTripClick: The Log Files of a Large Health Web Search Engine
Click logs are valuable resources for a variety of information retrieval (IR) tasks. This includes query understanding/analysis, as well as learning effective IR models particularly when the models require large amounts …
Information RetrievalRetrievalCODER: An efficient framework for improving retrieval through COntextual Document Embedding Reranking
Contrastive learning has been the dominant approach to training dense retrieval models. In this work, we investigate the impact of ranking context - an often overlooked aspect of learning dense retrieval models. In parti…
Contrastive LearningDocument EmbeddingRerankingRetrievalBenchmarking Middle-Trained Language Models for Neural Search
Middle training methods aim to bridge the gap between the Masked Language Model (MLM) pre-training and the final finetuning for retrieval. Recent models such as CoCondenser, RetroMAE, and LexMAE argue that the MLM task i…
BenchmarkingLanguage ModelingLanguage ModellingRetrievalInteractive Multi-Turn Retrieval for Health Videos
The growing availability of health-related instructional videos creates new opportunities for clinical training, patient rehabilitation, and health education, yet existing retrieval systems remain largely single-turn: a …
Semantic RetrievalVideo Retrieval