MolMem: Memory-Augmented Agentic Reinforcement Learning for Sample-Efficient Molecular Optimization

2026-04-14 · Ziqing Wang, Yibo Wen, Abhishek Pandy, Han Liu, Kaize Ding arxiv

In drug discovery, molecular optimization aims to iteratively refine a lead compound to improve molecular properties while preserving structural similarity to the original molecule. However, each oracle evaluation is expensive, making sample efficiency a key challenge for existing methods under a limited oracle budget. Trial-and-error approaches require many oracle calls, while methods that leverage external knowledge tend to reuse familiar templates and struggle on challenging objectives. A key missing piece is long-term memory that can ground decisions and provide reusable insights for future optimizations. To address this, we present MolMem (\textbf{Mol}ecular optimization with \textbf{Mem}ory), a multi-turn agentic reinforcement learning (RL) framework with a dual-memory system. Specifically, MolMem uses Static Exemplar Memory to retrieve relevant exemplars for cold-start grounding, and Evolving Skill Memory to distill successful trajectories into reusable strategies. Built on this memory-augmented formulation, we train the policy with dense step-wise rewards, turning costly rollouts into long-term knowledge that improves future optimization. Extensive experiments show that MolMem achieves 90\% success on single-property tasks (1.5$\times$ over the best baseline) and 52\% on multi-property tasks using only 500 oracle calls. Our code is available at https://github.com/REAL-Lab-NU/MolMem.

📄 PDF Abstract BibTeX arXiv:2604.12237

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning Drug Discovery

Agentic Recommender System with Hierarchical Belief-State Memory

2026-05-14 · Xiang Shen, Yuhang Zhou, Yifan Wu, Zhuokai Zhao 외 arxiv

Memory-augmented LLM agents have advanced personalized recommendation, yet existing approaches universally adopt flat memory representations that conflate ephemeral signals with stable preferences, and none provides a co…

Oblivion: Self-Adaptive Agentic Memory Control through Decay-Driven Activation

2026-03-31 · Ashish Rana, Chia-Chien Hung, Qumeng Sun, Julian Martin Kunkel 외 arxiv

Human memory adapts through selective forgetting: experiences become less accessible over time but can be reactivated by reinforcement or contextual cues. In contrast, memory-augmented LLM agents rely on "always-on" retr…

KernelBlaster: Continual Cross-Task CUDA Optimization via Memory-Augmented In-Context Reinforcement Learning

2026-02-15 · Kris Shengjun Dong, Sahil Modi, Dima Nikiforov, Sana Damani 외 arxiv

Optimizing CUDA code across multiple generations of GPU architectures is challenging, as achieving peak performance requires an extensive exploration of an increasingly complex, hardware-specific optimization space. Trad…

Reinforcement Learning

Agentic Memory: Learning Unified Long-Term and Short-Term Memory Management for Large Language Model Agents

2026-01-05 · Yi Yu, Liuyi Yao, Yuexiang Xie, Qingquan Tan 외 arxiv

Large language model (LLM) agents face fundamental limitations in long-horizon reasoning due to finite context windows, making effective memory management critical. Existing methods typically handle long-term memory (LTM…

Reinforcement Learning

GraphPlanner: Graph Memory-Augmented Agentic Routing for Multi-Agent LLMs

2026-04-26 · Tao Feng, Haozhen Zhang, Zijie Lei, Peixuan Han 외 arxiv

LLM routing has achieved promising results in integrating the strengths of diverse models while balancing efficiency and performance. However, to support more realistic and challenging applications, routing must extend i…

Computational Efficiency Reinforcement Learning