Evaluating Retrieval for Multi-domain Scientific Publications
This paper provides an overview of the xDD/LAPPS Grid framework and provides results of evaluating the AskMe retrievalengine using the BEIR benchmark datasets. Our primary goal is to determine a solid baseline of performance to guide furtherdevelopment of our retrieval capabilities. Beyond this, we aim to dig deeper to determine when and why certain approachesperform well (or badly) on both in-domain and out-of-domain data, an issue that has to date received relatively little attention.
Code (0)
등록된 구현이 없습니다.
Tasks
RetrievalSimilar Papers 제목 키워드 기반
Harnessing multiple LLMs for Information Retrieval: A case study on Deep Learning methodologies in Biodiversity publications
Deep Learning (DL) techniques are increasingly applied in scientific studies across various domains to address complex research questions. However, the methodological details of these DL models are often hidden in the un…
Information RetrievalRAGRetrievalRetrieval-augmented Generation+1On the Effectiveness of Large Language Models in Automating Categorization of Scientific Texts
The rapid advancement of Large Language Models (LLMs) has led to a multitude of application opportunities. One traditional task for Information Retrieval systems is the summarization and classification of texts, both of …
Information RetrievalMulti-label Classification of Scientific Research Documents Across Domains and Languages
Automatically organizing scholarly literature is a necessary and challenging task. By assigning scientific research publications key concepts, researchers, policymakers, and the general public are able to search for and …
ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONtext-classification+1Ask, Retrieve, Summarize: A Modular Pipeline for Scientific Literature Summarization
The exponential growth of scientific publications has made it increasingly difficult for researchers to stay updated and synthesize knowledge effectively. This paper presents XSum, a modular pipeline for multi-document s…
Document SummarizationMulti-Document SummarizationQuestion GenerationQuestion-Generation+3A Search Engine for Scientific Publications: a Cybersecurity Case Study
Cybersecurity is a very challenging topic of research nowadays, as digitalization increases the interaction of people, software and services on the Internet by means of technology devices and networks connected to it. Th…
Information RetrievalManagementReading ComprehensionRetrieval