paper-with-me

홈 › Papers

Multimodal Alignment and Preference Optimization for Zero-Shot Conditional RNA Generation

2026-05-12 · Roman Klypa, Alberto Bietti, Sergei Grudinin arxiv

The design of RNA molecules that interact with specific proteins is a critical challenge in experimental and computational biology. Despite recent progress in natural language modeling and deep learning-based protein design, there remains significant room to improve the frequency of successful interactions and the authenticity of generated sequences for functional applications. In this work, we frame conditional RNA sequence generation as a multi-stage alignment problem, introducing Moirain: a suite of models optimized via multimodal supervised fine-tuning (SFT) and Direct Preference Optimization (DPO). Our approach begins with large-scale pretraining on diverse RNA corpora to capture the fundamental grammars of sequence plausibility. To achieve target-specific generation, we employ a multimodal SFT architecture that conditions RNA synthesis on protein structural and sequential features. Finally, we leverage DPO to refine the model using synthetic interaction data: taking advantage of DPO's unique ability to navigate non-aligned preference spaces, we improve functional fitness without collapsing the learned natural distribution. Extensive evaluation of the Moirain series (Moirain-Base, -Multi, and -DPO) demonstrates that our framework consistently produces novel, diverse, and biologically plausible RNA sequences with superior binding affinities compared to existing baselines.

📄 PDF Abstract BibTeX arXiv:2605.23961

Code (0)

등록된 구현이 없습니다.

Tasks

Protein Design

Similar Papers 제목 키워드 기반

Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment

2024-12-26 · CVPR 2025 1 · Ziang Yan, Zhilin Li, Yinan He, Chenting Wang 외

Current multimodal large language models (MLLMs) struggle with fine-grained or precise understanding of visuals though they give comprehensive perception and reasoning in a spectrum of vision applications. Recent studies…

Auto-Rubric as Reward: From Implicit Preferences to Explicit Multimodal Generative Criteria

2026-05-08 · Juanxi Tian, Fengyuan Liu, Jiaming Han, Yilei Jiang 외 arxiv

Aligning multimodal generative models with human preferences demands reward signals that respect the compositional, multi-dimensional structure of human judgment. Prevailing RLHF approaches reduce this structure to scala…

Text-to-Image GenerationImage Editing

Multimodal Knowledge Alignment with Reinforcement Learning

2022-05-25 · Youngjae Yu, Jiwan Chung, Heeseung Yun, Jack Hessel 외

Large language models readily adapt to novel settings, even without task-specific training data. Can their zero-shot capacity be extended to multimodal inputs? In this work, we propose ESPER which extends language-only z…

Audio captioningLanguage ModelingLanguage Modellingreinforcement-learning+3

SAGE: A Visual Language Model for Anomaly Detection via Fact Enhancement and Entropy-aware Alignment

2025-07-10 · Guoxin Zang, Xue Li, Donglin Di, Lanshun Nie 외 arxiv

While Vision-Language Models (VLMs) have shown promising progress in general multimodal tasks, they often struggle in industrial anomaly detection and reasoning, particularly in delivering interpretable explanations and …

Anomaly DetectionVisual Reasoning

POVQA: Preference-Optimized Video Question Answering with Rationales for Data Efficiency

2025-10-01 · Ashim Dahal, Ankit Ghimire, Saydul Akbar Murad, Nick Rahimi arxiv

Long-video multimodal question answering requires structured reasoning over visual evidence and dialogue, but Large Vision-Language Models (LVLMs) are constrained by context-window and compute limits. We propose POVQA, w…

Video Question AnsweringMultimodal Reasoning