paper-with-me

Papers

UMBRELA: UMbrela is the (Open-Source Reproduction of the) Bing RELevance Assessor

2024-06-10 · Shivani Upadhyay, Ronak Pradeep, Nandan Thakur, Nick Craswell, Jimmy Lin

Copious amounts of relevance judgments are necessary for the effective training and accurate evaluation of retrieval systems. Conventionally, these judgments are made by human assessors, rendering this process expensive and laborious. A recent study by Thomas et al. from Microsoft Bing suggested that large language models (LLMs) can accurately perform the relevance assessment task and provide human-quality judgments, but unfortunately their study did not yield any reusable software artifacts. Our work presents UMBRELA (a recursive acronym that stands for UMbrela is the Bing RELevance Assessor), an open-source toolkit that reproduces the results of Thomas et al. using OpenAI's GPT-4o model and adds more nuance to the original paper. Across Deep Learning Tracks from TREC 2019 to 2023, we find that LLM-derived relevance judgments correlate highly with rankings generated by effective multi-stage retrieval systems. Our toolkit is designed to be easily extensible and can be integrated into existing multi-stage retrieval and evaluation pipelines, offering researchers a valuable resource for studying retrieval evaluation methodologies. UMBRELA will be used in the TREC 2024 RAG Track to aid in relevance assessments, and we envision our toolkit becoming a foundation for further innovation in the field. UMBRELA is available at https://github.com/castorini/umbrela.

📄 PDF Abstract BibTeX arXiv:2406.06519

Code (1)

castorini/umbrela 공식 구현 pytorch

Tasks

RAGRetrieval

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
WordPiece 설명 없음
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Weight Decay 설명 없음
Residual Connection 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

A Large-Scale Study of Relevance Assessments with Large Language Models: An Initial Look

2024-11-13 · Shivani Upadhyay, Ronak Pradeep, Nandan Thakur, Daniel Campos 외

The application of large language models to provide relevance assessments presents exciting opportunities to advance information retrieval, natural language processing, and beyond, but to date many unknowns remain. This …

Information RetrievalRAG

A Human-AI Comparative Analysis of Prompt Sensitivity in LLM-Based Relevance Judgment

2025-04-16 · Negar Arabzadeh, Charles L. A . Clarke

Large Language Models (LLMs) are increasingly used to automate relevance judgments for information retrieval (IR) tasks, often demonstrating agreement with human labels that approaches inter-human agreement. To assess th…

Information RetrievalRAGRetrievalRetrieval-augmented Generation+1

Re-Rankers as Relevance Judges

2026-01-08 · Chuan Meng, Jiqun Liu, Mohammad Aliannejadi, Fengran Mo 외 arxiv

Using large language models (LLMs) to predict relevance judgments has shown promising results. Most studies treat this task as a distinct research line, e.g., focusing on prompt design for predicting relevance labels giv…

LLM-based relevance assessment still can't replace human relevance assessment

2024-12-22 · Charles L. A. Clarke, Laura Dietz

The use of large language models (LLMs) for relevance assessment in information retrieval has gained significant attention, with recent studies suggesting that LLM-based judgments provide comparable evaluations to human …

Information Retrieval

SWE-Tester: Training Open-Source LLMs for Issue Reproduction in Real-World Repositories

2026-01-20 · Aditya Bharat Soni, Rajat Ghosh, Vaishnavi Bhargava, Valerie Chen 외 arxiv

Software testing is crucial for ensuring the correctness and reliability of software systems. Automated generation of issue reproduction tests from natural language issue descriptions enhances developer productivity by s…