Retrieval-Enhanced Mutation Mastery: Augmenting Zero-Shot Prediction of Protein Language Model

2024-10-28 · Yang Tan, Ruilin Wang, Banghao Wu, Liang Hong, Bingxin Zhou

Enzyme engineering enables the modification of wild-type proteins to meet industrial and research demands by enhancing catalytic activity, stability, binding affinities, and other properties. The emergence of deep learning methods for protein modeling has demonstrated superior results at lower costs compared to traditional approaches such as directed evolution and rational design. In mutation effect prediction, the key to pre-training deep learning models lies in accurately interpreting the complex relationships among protein sequence, structure, and function. This study introduces a retrieval-enhanced protein language model for comprehensive analysis of native properties from sequence and local structural interactions, as well as evolutionary properties from retrieved homologous sequences. The state-of-the-art performance of the proposed ProtREM is validated on over 2 million mutants across 217 assays from an open benchmark (ProteinGym). We also conducted post-hoc analyses of the model's ability to improve the stability and binding affinity of a VHH antibody. Additionally, we designed 10 new mutants on a DNA polymerase and conducted wet-lab experiments to evaluate their enhanced activity at higher temperatures. Both in silico and experimental evaluations confirmed that our method provides reliable predictions of mutation effects, offering an auxiliary tool for biologists aiming to evolve existing enzymes. The implementation is publicly available at https://github.com/tyang816/ProtREM.

📄 PDF Abstract BibTeX arXiv:2410.21127

Code (1)

tyang816/protrem 공식 구현 pytorch

Tasks

Language ModelingLanguage Modelling Protein Language Model Retrieval

Augmenting Zero-Shot Dense Retrievers with Plug-in Mixture-of-Memories

2023-02-07 · Suyu Ge, Chenyan Xiong, Corby Rosset, Arnold Overwijk 외

In this paper we improve the zero-shot generalization ability of language models via Mixture-Of-Memory Augmentation (MoMA), a mechanism that retrieves augmentation documents from multiple information corpora ("external m…

Retrieval Zero-shot Generalization

Zero-RAG: Towards Retrieval-Augmented Generation with Zero Redundant Knowledge

2025-11-01 · Qi Luo, Xiaonan Li, Junqi Dai, Shuang Cheng 외 arxiv

Retrieval-Augmented Generation has shown remarkable results to address Large Language Models' hallucinations, which usually uses a large external corpus to supplement knowledge to LLMs. However, with the development of L…

On-The-Fly Information Retrieval Augmentation for Language Models

2020-07-03 · WS 2020 7 · Hai Wang, David Mcallester

Here we experiment with the use of information retrieval as an augmentation for pre-trained language models. The text corpus used in information retrieval can be viewed as form of episodic memory which grows over time. B…

Information Retrieval Retrieval

From 50% to Mastery in 3 Days: A Low-Resource SOP for Localizing Graduate-Level AI Tutors via Shadow-RAG

2026-03-21 · Zonglin Yang, J. -H. Xie, Lining Zhang, Jiyou Jia 외 arxiv

Deploying high-fidelity AI tutors in schools is often blocked by the Resource Curse -- the need for expensive cloud GPUs and massive data engineering. In this practitioner report, we present a replicable Standard Operati…

Audiobox TTA-RAG: Improving Zero-Shot and Few-Shot Text-To-Audio with Retrieval-Augmented Generation

2024-11-07 · Mu Yang, Bowen Shi, Matthew Le, Wei-Ning Hsu 외

This work focuses on improving Text-To-Audio (TTA) generation on zero-shot and few-shot settings (i.e. generating unseen or uncommon audio events). Inspired by the success of Retrieval-Augmented Generation (RAG) in Large…

Audio Generation Large Language Model RAG Retrieval+1