paper-with-me

Papers

A Reward-Directed Diffusion Framework for Generative Design Optimization

2025-08-02 · Hadi Keramati, Patrick Kirchen, Mohammed Hannan, Rajeev K. Jaiman arxiv

This study presents a generative optimization framework that builds on a fine-tuned diffusion model and reward-directed sampling to generate high-performance engineering designs. The framework adopts a parametric representation of the design geometry and produces new parameter sets corresponding to designs with enhanced performance metrics. A key advantage of the reward-directed approach is its suitability for scenarios in which performance metrics rely on costly engineering simulations or surrogate models (e.g. graph-based, ensemble models, or tree-based) are non-differentiable or prohibitively expensive to differentiate. This work introduces the iterative use of a soft value function within a Markov decision process framework to achieve reward-guided decoding in the diffusion model. By incorporating soft-value guidance during both the training and inference phases, the proposed approach reduces computational and memory costs to achieve high-reward designs, even beyond the training data. Empirical results indicate that this iterative reward-directed method substantially improves the ability of the diffusion models to generate samples with reduced resistance in 3D ship hull design and enhanced hydrodynamic performance in 2D airfoil design tasks. The proposed framework generates samples that extend beyond the training data distribution, resulting in a greater 25 percent reduction in resistance for ship design and over 10 percent improvement in the lift-to-drag ratio for the 2D airfoil design. Successful integration of this model into the engineering design life cycle can enhance both designer productivity and overall design performance.

📄 PDF Abstract BibTeX arXiv:2508.01509

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Diffusion Model for Data-Driven Black-Box Optimization

2024-03-20 · Zihao Li, Hui Yuan, Kaixuan Huang, Chengzhuo Ni 외

Generative AI has redefined artificial intelligence, enabling the creation of innovative content and customized solutions that drive business practices into a new era of efficiency and creativity. In this paper, we focus…

DGPO: RL-Steered Graph Diffusion for Neural Architecture Generation

2026-02-22 · Aleksei Liuliakov, Luca Hermes, Barbara Hammer arxiv

Reinforcement learning fine-tuning has proven effective for steering generative diffusion models toward desired properties in image and molecular domains. Graph diffusion models have similarly been applied to combinatori…

Neural Architecture SearchReinforcement Learning

Reward-Directed Conditional Diffusion: Provable Distribution Estimation and Reward Improvement

2023-07-13 · NeurIPS 2023 11

We explore the methodology and theory of reward-directed generation via conditional diffusion models. Directed generation aims to generate samples with desired properties as measured by a reward function, which has broad…

Reward-Directed Score-Based Diffusion Models via q-Learning

2024-09-07 · Xuefeng Gao, Jiale Zha, Xun Yu Zhou

We propose a new reinforcement learning (RL) formulation for training continuous-time score-based diffusion models for generative AI to generate samples that maximize reward functions while keeping the generated distribu…

Q-LearningReinforcement Learning (RL)

Censored Sampling for Topology Design: Guiding Diffusion with Human Preferences

2025-08-03 · Euihyun Kim, Keun Park, Yeoneung Kim arxiv

Recent advances in denoising diffusion models have enabled rapid generation of optimized structures for topology optimization. However, these models often rely on surrogate predictors to enforce physical constraints, whi…