paper-with-me

홈 › Papers

Saturn: Sample-efficient Generative Molecular Design using Memory Manipulation

2024-05-27 · Jeff Guo, Philippe Schwaller

Generative molecular design for drug discovery has very recently achieved a wave of experimental validation, with language-based backbones being the most common architectures employed. The most important factor for downstream success is whether an in silico oracle is well correlated with the desired end-point. To this end, current methods use cheaper proxy oracles with higher throughput before evaluating the most promising subset with high-fidelity oracles. The ability to directly optimize high-fidelity oracles would greatly enhance generative design and be expected to improve hit rates. However, current models are not efficient enough to consider such a prospect, exemplifying the sample efficiency problem. In this work, we introduce Saturn, which leverages the Augmented Memory algorithm and demonstrates the first application of the Mamba architecture for generative molecular design. We elucidate how experience replay with data augmentation improves sample efficiency and how Mamba synergistically exploits this mechanism. Saturn outperforms 22 models on multi-parameter optimization tasks relevant to drug discovery and may possess sufficient sample efficiency to consider the prospect of directly optimizing high-fidelity oracles.

📄 PDF Abstract BibTeX arXiv:2405.17066

Code (2)

schwallergroup/augmented_memory 공식 구현
schwallergroup/saturn 공식 구현

Tasks

Data AugmentationDrug DiscoveryMamba

Methods 이 논문이 사용한 방법론

Experience Replay Experience Replay is a replay memory technique used in reinforcement learning where we store the agent’s experiences at each time-step, $e\_{t} = \left(s\_{t}, a\_{t}, r\_{t},…

Similar Papers 제목 키워드 기반

Saturn Platform: Foundation Model Operations and Generative AI for Financial Services

2023-12-12 · Antonio J. G. Busson, Rennan Gaio, Rafael H. Rocha, Francisco Evangelista 외

Saturn is an innovative platform that assists Foundation Model (FM) building and its integration with IT operations (Ops). It is custom-made to meet the requirements of data scientists, enabling them to effectively creat…

SATURN: SAT-based Reinforcement Learning to Unleash Language Model Reasoning

2025-05-22 · Huanyu Liu, Jia Li, Hao Zhu, Kechi Zhang 외

How to design reinforcement learning (RL) tasks that effectively unleash the reasoning capability of large language models (LLMs) remains an open question. Existing RL tasks (e.g., math, programming, and constructing rea…

Language ModelingLanguage ModellingMathReinforcement Learning (RL)

Beam Enumeration: Probabilistic Explainability For Sample Efficient Self-conditioned Molecular Design

2023-09-25 · Jeff Guo, Philippe Schwaller

Generative molecular design has moved from proof-of-concept to real-world applicability, as marked by the surge in very recent papers reporting experimental validation. Key challenges in explainability and sample efficie…

Augmented Memory: Capitalizing on Experience Replay to Accelerate De Novo Molecular Design

2023-05-10 · Jeff Guo, Philippe Schwaller

Sample efficiency is a fundamental challenge in de novo molecular design. Ideally, molecular generative models should learn to satisfy a desired objective under minimal oracle evaluations (computational prediction or wet…

Data AugmentationDrug Discovery

Deep Evolutionary Learning for Molecular Design

2020-12-28 · Yifeng Li, Hsu Kiang Ooi, Alain Tchagang

In this paper, we propose a deep evolutionary learning (DEL) process that integrates fragment-based deep generative model and multi-objective evolutionary computation for molecular design. Our approach enables (1) evolut…

Bayesian Optimization