paper-with-me

Papers

Constrained Flow Optimization via Sequential Fine Tuning for Molecular Design

2026-05-28 · Sven Gutjahr, Riccardo De Santi, Luca Schaufelberger, Kjell Jorner, Andreas Krause arxiv

Adapting generative foundation models, in particular diffusion and flow models, to optimize given reward functions (e.g., binding affinity) while satisfying constraints (e.g., molecular synthesizability) is fundamental for their adoption in real-world scientific discovery applications such as molecular design or protein engineering. While recent works have introduced scalable methods for reward-guided fine-tuning of such models via reinforcement learning and control schemes, it remains an open problem how to algorithmically trade-off reward maximization and constraint satisfaction in a reliable and predictable manner. Motivated by this challenge, we first present a rigorous framework for Constrained Generative Optimization, which brings an optimization viewpoint to the introduced adaptation problem and retrieves the relevant task of constrained generation as a sub-case. Then, we introduce Constrained Flow Optimization (CFO), an algorithm that automatically and provably balances reward maximization and constraint satisfaction by reducing the original problem to sequential fine-tuning via established, scalable methods. We provide convergence guarantees for constrained generative optimization and constrained generation via CFO. Ultimately, we present an experimental evaluation of CFO on both synthetic, yet illustrative, settings, and a molecular design task. Across these evaluations, CFO achieves consistent increases in reward while ensuring high constraint satisfaction, showcasing its practical utility for constrained generative optimization.

📄 PDF Abstract BibTeX arXiv:2605.30610

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

Finetuning Foundation Models for Joint Analysis Optimization

2024-01-24 · Matthias Vigl, Nicole Hartman, Lukas Heinrich

In this work we demonstrate that significant gains in performance and data efficiency can be achieved in High Energy Physics (HEP) by moving beyond the standard paradigm of sequential optimization or reconstruction and a…

Domain Adaptation

Preserving Foundational Capabilities in Flow-Matching VLAs through Conservative SFT

2026-05-09 · Tianyi Zhang, Shaopeng Zhai, Haoran Zhang, Fuxian Huang 외 arxiv

Unconstrained fine-tuning of flow-matching Vision-Language-Action (VLA) models drives dense parameter overwrites, degrading pre-trained capabilities. We present Conservative Supervised Fine-Tuning (ConSFT), an optimizati…

Reinforcement Learning

Automotive Engineering-Centric Agentic AI Workflow Framework

2026-04-09 · Tong Duy Son, Zhihao Liu, Piero Brigida, Yerlan Akhmetov 외 arxiv

Engineering workflows such as design optimization, simulation-based diagnosis, control tuning, and model-based systems engineering (MBSE) are iterative, constraint-driven, and shaped by prior decisions. Yet many AI metho…

Reinforcement Learning

GFlowVLM: Enhancing Multi-step Reasoning in Vision-Language Models with Generative Flow Networks

2025-03-09 · CVPR 2025 1 · Haoqiang Kang, Enna Sachdeva, Piyush Gupta, Sangjae Bae 외

Vision-Language Models (VLMs) have recently shown promising advancements in sequential decision-making tasks through task-specific fine-tuning. However, common fine-tuning methods, such as Supervised Fine-Tuning (SFT) an…

Card GamesDiversityReinforcement Learning (RL)Sequential Decision Making

Vehicle Cabin Climate MPC Parameter Tuning Using Constrained Contextual Bayesian Optimization (C-CMES)

2023-10-05 · David Stenger, Tim Reuscher, Heike Vallery, Dirk Abel

Climate-controlled cabins have for decades been standard in vehicles. Model Predictive Controllers (MPCs) have shown promising results in achieving temperature tracking in vehicle cabins and may improve upon model-free c…

Bayesian Optimization