What Makes a Top-Performing Precision Medicine Search Engine? Tracing Main System Features in a Systematic Way
From 2017 to 2019 the Text REtrieval Conference (TREC) held a challenge task on precision medicine using documents from medical publications (PubMed) and clinical trials. Despite lots of performance measurements carried out in these evaluation campaigns, the scientific community is still pretty unsure about the impact individual system features and their weights have on the overall system performance. In order to overcome this explanatory gap, we first determined optimal feature configurations using the Sequential Model-based Algorithm Configuration (SMAC) program and applied its output to a BM25-based search engine. We then ran an ablation study to systematically assess the individual contributions of relevant system features: BM25 parameters, query type and weighting schema, query expansion, stop word filtering, and keyword boosting. For evaluation, we employed the gold standard data from the three TREC-PM installments to evaluate the effectiveness of different features using the commonly shared infNDCG metric.
Code (0)
등록된 구현이 없습니다.
Tasks
RetrievalSMACSMAC+Text RetrievalSimilar Papers 제목 키워드 기반
Learning Embeddings from Cancer Mutation Sets for Classification Tasks
Analysis of somatic mutation profiles from cancer patients is essential in the development of cancer research. However, the low frequency of most mutations and the varying rates of mutations across patients makes the dat…
ClassificationClusteringGeneral ClassificationPrecision Medicine as an Accelerator for Next Generation Cognitive Supercomputing
In the past several years, we have taken advantage of a number of opportunities to advance the intersection of next generation high-performance computing AI and big data technologies through partnerships in precision med…
Integrative AI-Driven Strategies for Advancing Precision Medicine in Infectious Diseases and Beyond: A Novel Multidisciplinary Approach
Precision medicine, tailored to individual patients based on their genetics, environment, and lifestyle, shows promise in managing complex diseases like infections. Integrating artificial intelligence (AI) into precision…
ManagementPrognosisA data-driven method for syndrome type identification and classification in traditional Chinese medicine
Objective: The efficacy of traditional Chinese medicine (TCM) treatments for Western medicine (WM) diseases relies heavily on the proper classification of patients into TCM syndrome types. We develop a data-driven method…
ClassificationGeneral ClassificationVocal Bursts Type PredictionBandit Algorithms for Precision Medicine
The Oxford English Dictionary defines precision medicine as "medical care designed to optimize efficiency or therapeutic benefit for particular groups of patients, especially by using genetic or molecular profiling." It …