Assessing Reusability of Deep Learning-Based Monotherapy Drug Response Prediction Models Trained with Omics Data
Cancer drug response prediction (DRP) models present a promising approach towards precision oncology, tailoring treatments to individual patient profiles. While deep learning (DL) methods have shown great potential in this area, models that can be successfully translated into clinical practice and shed light on the molecular mechanisms underlying treatment response will likely emerge from collaborative research efforts. This highlights the need for reusable and adaptable models that can be improved and tested by the wider scientific community. In this study, we present a scoring system for assessing the reusability of prediction DRP models, and apply it to 17 peer-reviewed DL-based DRP models. As part of the IMPROVE (Innovative Methodologies and New Data for Predictive Oncology Model Evaluation) project, which aims to develop methods for systematic evaluation and comparison DL models across scientific domains, we analyzed these 17 DRP models focusing on three key categories: software environment, code modularity, and data availability and preprocessing. While not the primary focus, we also attempted to reproduce key performance metrics to verify model behavior and adaptability. Our assessment of 17 DRP models reveals both strengths and shortcomings in model reusability. To promote rigorous practices and open-source sharing, we offer recommendations for developing and sharing prediction models. Following these recommendations can address many of the issues identified in this study, improving model reusability without adding significant burdens on researchers. This work offers the first comprehensive assessment of reusability and reproducibility across diverse DRP models, providing insights into current model sharing practices and promoting standards within the DRP and broader AI-enabled scientific research community.
Code (0)
등록된 구현이 없습니다.
Tasks
Drug Response PredictionSimilar Papers 제목 키워드 기반
A pharmacokinetic -- viral kinetic model describes the effect of alisporivir monotherapy or in combination with peg-IFN on 2 hepatitis C virologic response
Alisporivir is a cyclophilin inhibitor with demonstrated in vitro and in vivo activity against hepatitis C 11 virus (HCV). We estimated antiviral effectiveness of alisporivir alone or in combination with 12 pegylated-Int…
Data augmentation and multimodal learning for predicting drug response in patient-derived xenografts from gene expressions and histology images
Patient-derived xenografts (PDXs) are an appealing platform for preclinical drug studies because the in vivo environment of PDXs helps preserve tumor heterogeneity and usually better mimics drug response of patients with…
Data AugmentationDrug Response Predictionwhole slide imagesLearning Curves for Drug Response Prediction in Cancer Cell Lines
Motivated by the size of cell line drug sensitivity data, researchers have been developing machine learning (ML) models for predicting drug response to advance cancer treatment. As drug sensitivity studies continue gener…
Drug Response PredictionSensitivityZero-shot Learning of Drug Response Prediction for Preclinical Drug Screening
Conventional deep learning methods typically employ supervised learning for drug response prediction (DRP). This entails dependence on labeled response data from drugs for model training. However, practical applications …
Domain AdaptationDrug DiscoveryDrug Response PredictionZero-Shot LearningEnsemble Transfer Learning for the Prediction of Anti-Cancer Drug Response
Transfer learning has been shown to be effective in many applications in which training data for the target problem are limited but data for a related (source) problem are abundant. In this paper, we apply transfer learn…
Drug Response PredictionPredictionTransfer Learning