Large-scale Pretraining Improves Sample Efficiency of Active Learning based Molecule Virtual Screening
Virtual screening of large compound libraries to identify potential hit candidates is one of the earliest steps in drug discovery. As the size of commercially available compound collections grows exponentially to the scale of billions, brute-force virtual screening using traditional tools such as docking becomes infeasible in terms of time and computational resources. Active learning and Bayesian optimization has recently been proven as effective methods of narrowing down the search space. An essential component in those methods is a surrogate machine learning model that is trained with a small subset of the library to predict the desired properties of compounds. Accurate model can achieve high sample efficiency by finding the most promising compounds with only a fraction of the whole library being virtually screened. In this study, we examined the performance of pretrained transformer-based language model and graph neural network in Bayesian optimization active learning framework. The best pretrained models identifies 58.97% of the top-50000 by docking score after screening only 0.6% of an ultra-large library containing 99.5 million compounds, improving 8% over previous state-of-the-art baseline. Through extensive benchmarks, we show that the superior performance of pretrained models persists in both structure-based and ligand-based drug discovery. Such model can serve as a boost to the accuracy and sample efficiency of active learning based molecule virtual screening.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningBayesian OptimizationDrug DiscoveryGraph Neural NetworkLanguage ModellingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Towards Bridging the Gap between Large-Scale Pretraining and Efficient Finetuning for Humanoid Control
Reinforcement learning (RL) is widely used for humanoid control, with on-policy methods such as Proximal Policy Optimization (PPO) enabling robust training via large-scale parallel simulation and, in some cases, zero-sho…
Reinforcement LearningPretraining Frequency Predicts Compositional Generalization of CLIP on Real-World Tasks
We investigate the success conditions for compositional generalization of CLIP models on real-world data through performance prediction. Prior work shows that CLIP requires exponentially more pretraining data for linear …
Spatial Transcriptomics as Images for Large-Scale Pretraining
Spatial Transcriptomics (ST) profiles thousands of gene expression values at discrete spots with precise coordinates on tissue sections, preserving spatial context essential for clinical and pathological studies. With ri…
Discriminative Representation Learning for Clinical Prediction
Foundation models in healthcare have largely adopted self supervised pretraining objectives inherited from natural language processing and computer vision, emphasizing reconstruction and large scale representation learni…
Representation LearningSample-Efficient Multi-Agent Reinforcement Learning with Demonstrations for Flocking Control
Flocking control is a significant problem in multi-agent systems such as multi-agent unmanned aerial vehicles and multi-agent autonomous underwater vehicles, which enhances the cooperativity and safety of agents. In cont…
Multi-agent Reinforcement Learningreinforcement-learningReinforcement Learning (RL)