paper-with-me

홈 › Papers

GROOT: Effective Design of Biological Sequences with Limited Experimental Data

2024-11-18 · Thanh V. T. Tran, Nhat Khang Ngo, Viet Anh Nguyen, Truong Son Hy

Latent space optimization (LSO) is a powerful method for designing discrete, high-dimensional biological sequences that maximize expensive black-box functions, such as wet lab experiments. This is accomplished by learning a latent space from available data and using a surrogate model to guide optimization algorithms toward optimal outputs. However, existing methods struggle when labeled data is limited, as training the surrogate model with few labeled data points can lead to subpar outputs, offering no advantage over the training data itself. We address this challenge by introducing GROOT, a Graph-based Latent Smoothing for Biological Sequence Optimization. In particular, GROOT generates pseudo-labels for neighbors sampled around the training latent embeddings. These pseudo-labels are then refined and smoothed by Label Propagation. Additionally, we theoretically and empirically justify our approach, demonstrate GROOT's ability to extrapolate to regions beyond the training set while maintaining reliability within an upper bound of their expected distances from the training regions. We evaluate GROOT on various biological sequence design tasks, including protein optimization (GFP and AAV) and three tasks with exact oracles from Design-Bench. The results demonstrate that GROOT equalizes and surpasses existing methods without requiring access to black-box oracles or vast amounts of labeled data, highlighting its practicality and effectiveness. We release our code at https://anonymous.4open.science/r/GROOT-D554

📄 PDF Abstract BibTeX arXiv:2411.11265

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

GROOT: Corrective Reward Optimization for Generative Sequential Labeling

2022-09-29 · Kazuma Hashimoto, Karthik Raman

Sequential labeling is a fundamental NLP task, forming the backbone of many applications. Supervised learning of Seq2Seq models has shown great success on these problems. However, the training objectives are still signif…

Decoder

Message-Enhanced DeGroot Model

2024-02-29 · Huisheng Wang, Zhanjiang Chen, H. Vicky Zhao

Understanding the impact of messages on agents' opinions over social networks is important. However, to our best knowledge, there has been limited quantitative investigation into this phenomenon in the prior works. To ad…

model

GrootVL: Tree Topology is All You Need in State Space Model

2024-06-04 · Yicheng Xiao, Lin Song, Shaoli Huang, Jiangshan Wang 외

The state space models, employing recursively propagated features, demonstrate strong representation capabilities comparable to Transformer models and superior efficiency. However, constrained by the inherent geometric c…

Allimage-classificationImage Classificationobject-detection+2

GROOT: Learning to Follow Instructions by Watching Gameplay Videos

2023-10-12 · Shaofei Cai, Bowei Zhang, ZiHao Wang, Xiaojian Ma 외

We study the problem of building a controller that can follow open-ended instructions in open-world environments. We propose to follow reference videos as instructions, which offer expressive goal specifications while el…

DecoderInstruction FollowingMinecraft

Efficient Training of Robust Decision Trees Against Adversarial Examples

2020-12-18 · Daniël Vos, Sicco Verwer

In the present day we use machine learning for sensitive tasks that require models to be both understandable and robust. Although traditional models such as decision trees are understandable, they suffer from adversarial…

Adversarial Attack