paper-with-me

Papers

Generative AI-based Prompt Evolution Engineering Design Optimization With Vision-Language Model

2024-06-13 · Melvin Wong, Thiago Rios, Stefan Menzel, Yew Soon Ong

Engineering design optimization requires an efficient combination of a 3D shape representation, an optimization algorithm, and a design performance evaluation method, which is often computationally expensive. We present a prompt evolution design optimization (PEDO) framework contextualized in a vehicle design scenario that leverages a vision-language model for penalizing impractical car designs synthesized by a generative model. The backbone of our framework is an evolutionary strategy coupled with an optimization objective function that comprises a physics-based solver and a vision-language model for practical or functional guidance in the generated car designs. In the prompt evolutionary search, the optimizer iteratively generates a population of text prompts, which embed user specifications on the aerodynamic performance and visual preferences of the 3D car designs. Then, in addition to the computational fluid dynamics simulations, the pre-trained vision-language model is used to penalize impractical designs and, thus, foster the evolutionary algorithm to seek more viable designs. Our investigations on a car design optimization problem show a wide spread of potential car designs generated at the early phase of the search, which indicates a good diversity of designs in the initial populations, and an increase of over 20\% in the probability of generating practical designs compared to a baseline framework without using a vision-language model. Visual inspection of the designs against the performance results demonstrates prompt evolution as a very promising paradigm for finding novel designs with good optimization performance while providing ease of use in specifying design specifications and preferences via a natural language interface.

📄 PDF Abstract BibTeX arXiv:2406.09143

Code (0)

등록된 구현이 없습니다.

Tasks

3D Shape RepresentationLanguage ModelingLanguage Modelling

Similar Papers 제목 키워드 기반

Large Language and Text-to-3D Models for Engineering Design Optimization

2023-07-03 · Thiago Rios, Stefan Menzel, Bernhard Sendhoff

The current advances in generative AI for learning large neural network models with the capability to produce essays, images, music and even 3D assets from text prompts create opportunities for a manifold of disciplines.…

Text to 3D

A Survey of Automatic Prompt Engineering: An Optimization Perspective

2025-02-17 · Wenwu Li, Xiangfeng Wang, Wenhao Li, Bo Jin

The rise of foundation models has shifted focus from resource-intensive fine-tuning to prompt engineering, a paradigm that steers model behavior through input design rather than weight updates. While manual prompt engine…

cross-modal alignmentPrompt EngineeringSurvey

Reflexive Prompt Engineering: A Framework for Responsible Prompt Engineering and Interaction Design

2025-04-22 · Christian Djeffal

Responsible prompt engineering has emerged as a critical framework for ensuring that generative artificial intelligence (AI) systems serve society's needs while minimizing potential harms. As generative AI applications b…

FairnessPrompt Engineering

MOPrompt: Multi-objective Semantic Evolution for Prompt Optimization

2025-08-03 · Sara Câmara, Eduardo Luz, Valéria Carvalho, Ivan Meneghini 외 arxiv

Prompt engineering is crucial for unlocking the potential of Large Language Models (LLMs). Still, since manual prompt design is often complex, non-intuitive, and time-consuming, automatic prompt optimization has emerged …

Sentiment AnalysisPrompt Engineering

Generative AI for Controllable Protein Sequence Design: A Survey

2024-02-16 · Yiheng Zhu, Zitai Kong, Jialu Wu, Weize Liu 외

The design of novel protein sequences with targeted functionalities underpins a central theme in protein engineering, impacting diverse fields such as drug discovery and enzymatic engineering. However, navigating this va…

Drug DiscoveryProtein DesignSurvey