EvoCAD: Evolutionary CAD Code Generation with Vision Language Models
Combining large language models with evolutionary computation algorithms represents a promising research direction leveraging the remarkable generative and in-context learning capabilities of LLMs with the strengths of evolutionary algorithms. In this work, we present EvoCAD, a method for generating computer-aided design (CAD) objects through their symbolic representations using vision language models and evolutionary optimization. Our method samples multiple CAD objects, which are then optimized using an evolutionary approach with vision language and reasoning language models. We assess our method using GPT-4V and GPT-4o, evaluating it on the CADPrompt benchmark dataset and comparing it to prior methods. Additionally, we introduce two new metrics based on topological properties defined by the Euler characteristic, which capture a form of semantic similarity between 3D objects. Our results demonstrate that EvoCAD outperforms previous approaches on multiple metrics, particularly in generating topologically correct objects, which can be efficiently evaluated using our two novel metrics that complement existing spatial metrics.
Code (0)
등록된 구현이 없습니다.
Tasks
Semantic SimilarityCode GenerationSimilar Papers 제목 키워드 기반
EvoVLMA: Evolutionary Vision-Language Model Adaptation
Pre-trained Vision-Language Models (VLMs) have been exploited in various Computer Vision tasks (e.g., few-shot recognition) via model adaptation, such as prompt tuning and adapters. However, existing adaptation methods a…
Image ClassificationCode GenerationToward Code Generation: A Survey and Lessons from Semantic Parsing
With the growth of natural language processing techniques and demand for improved software engineering efficiency, there is an emerging interest in translating intention from human languages to programming languages. In …
Code GenerationProgram SynthesisSemantic ParsingSurveySEMAG: Self-Evolutionary Multi-Agent Code Generation
Large Language Models (LLMs) have made significant progress in handling complex programming tasks. However, current methods rely on manual model selection and fixed workflows, which limit their ability to adapt to changi…
Code GenerationEvolutionary thoughts: integration of large language models and evolutionary algorithms
Large Language Models (LLMs) have unveiled remarkable capabilities in understanding and generating both natural language and code, but LLM reasoning is prone to hallucination and struggle with complex, novel scenarios, o…
Evolutionary AlgorithmsHallucinationvalidEPiC: Cost-effective Search-based Prompt Engineering of LLMs for Code Generation
Large Language Models (LLMs) have seen increasing use in various software development tasks, especially in code generation. The most advanced recent methods attempt to incorporate feedback from code execution into prompt…
Code GenerationPrompt Engineering