An Improved Metric and Benchmark for Assessing the Performance of Virtual Screening Models
Structure-based virtual screening (SBVS) is a key workflow in computational drug discovery. SBVS models are assessed by measuring the enrichment of known active molecules over decoys in retrospective screens. However, the standard formula for enrichment cannot estimate model performance on very large libraries. Additionally, current screening benchmarks cannot easily be used with machine learning (ML) models due to data leakage. We propose an improved formula for calculating VS enrichment and introduce the BayesBind benchmarking set composed of protein targets that are structurally dissimilar to those in the BigBind training set. We assess current models on this benchmark and find that none perform appreciably better than a KNN baseline.
Code (1)
Tasks
BenchmarkingDrug DiscoveryMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Building Trust in Virtual Immunohistochemistry: Automated Assessment of Image Quality
Deep learning models can generate virtual immunohistochemistry (IHC) stains from hematoxylin and eosin (H&E) images, offering a scalable and low-cost alternative to laboratory IHC. However, reliable evaluation of image q…
Assessing the effect of sample bias correction in species distribution models
Open-source biodiversity databases contain a large amount of species occurrence records, but these are often spatially biased, which affects the reliability of species distribution models based on these records. Sample b…
Optimal Participation of Heterogeneous, RES-based Virtual Power Plants in Energy Markets
In this work, we present a detailed model of a Renewable Energy Source (RES)-based Virtual Power Plant (VPP) that participates in Day-Ahead Market (DAM) and Intra-Day Market (IDM) with dispatchable and non-dispatchable R…
Quality assessment of 3D human animation: Subjective and objective evaluation
Virtual human animations have a wide range of applications in virtual and augmented reality. While automatic generation methods of animated virtual humans have been developed, assessing their quality remains challenging.…
Human AnimationEevee: Towards Close-up High-resolution Video-based Virtual Try-on
Video virtual try-on technology provides a cost-effective solution for creating marketing videos in fashion e-commerce. However, its practical adoption is hindered by two critical limitations. First, the reliance on a si…
Video GenerationVirtual Try-on