paper-with-me

Papers

Team IELAB at TREC Clinical Trial Track 2023: Enhancing Clinical Trial Retrieval with Neural Rankers and Large Language Models

2024-01-03 · Shengyao Zhuang, Bevan Koopman, Guido Zuccon

We describe team ielab from CSIRO and The University of Queensland's approach to the 2023 TREC Clinical Trials Track. Our approach was to use neural rankers but to utilise Large Language Models to overcome the issue of lack of training data for such rankers. Specifically, we employ ChatGPT to generate relevant patient descriptions for randomly selected clinical trials from the corpus. This synthetic dataset, combined with human-annotated training data from previous years, is used to train both dense and sparse retrievers based on PubmedBERT. Additionally, a cross-encoder re-ranker is integrated into the system. To further enhance the effectiveness of our approach, we prompting GPT-4 as a TREC annotator to provide judgments on our run files. These judgments are subsequently employed to re-rank the results. This architecture tightly integrates strong PubmedBERT-based rankers with the aid of SOTA Large Language Models, demonstrating a new approach to clinical trial retrieval.

📄 PDF Abstract BibTeX arXiv:2401.01566

Code (0)

등록된 구현이 없습니다.

Tasks

Retrieval

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Multi-Head Attention 설명 없음
Adam 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

TMU at TREC Clinical Trials Track 2023

2024-03-12 · Aritra Kumar Lahiri, Emrul Hasan, Qinmin Vivian Hu, Cherie Ding

This paper describes Toronto Metropolitan University's participation in the TREC Clinical Trials Track for 2023. As part of the tasks, we utilize advanced natural language processing techniques and neural language models…

ITTC @ TREC 2021 Clinical Trials Track

2022-02-16 · Thinh Hung Truong, Yulia Otmakhova, Rahmad Mahendra, Timothy Baldwin 외

This paper describes the submissions of the Natural Language Processing (NLP) team from the Australian Research Council Industrial Transformation Training Centre (ITTC) for Cognitive Computing in Medical Technologies to …

Retrieval

UNIMIB at TREC 2021 Clinical Trials Track

2022-07-27 · Georgios Peikos, Oscar Espitia, Gabriella Pasi

This contribution summarizes the participation of the UNIMIB team to the TREC 2021 Clinical Trials Track. We have investigated the effect of different query representations combined with several retrieval models on the r…

Keyword ExtractionRe-RankingRetrieval

Benchmarking Clinical Decision Support Search

2018-01-29 · Nguyen Vincent, Karimi Sarvnaz, Falamaki Sara, Paris Cecile

Finding relevant literature underpins the practice of evidence-based medicine. From 2014 to 2016, TREC conducted a clinical decision support track, wherein participants were tasked with finding articles relevant to clini…

ArticlesBenchmarkingDiversity

HPI-DHC at TREC 2018 Precision Medicine Track

2018-11-14 · Notebook papers of the TREC conference 2018 11 · Michel Oleynik, Erik Faessler, Ariane Morassi Sasso, Arpita Kappattanavar 외

The TREC-PM challenge aims for advances in the field of information retrieval applied to precision medicine. Here we describe our experimental setup and the achieved results in its 2018 edition. We explored the use of un…

ArticlesDocument ClassificationInformation RetrievalNegation+3