Sketch2Prototype: Rapid Conceptual Design Exploration and Prototyping with Generative AI
Sketch2Prototype is an AI-based framework that transforms a hand-drawn sketch into a diverse set of 2D images and 3D prototypes through sketch-to-text, text-to-image, and image-to-3D stages. This framework, shown across various sketches, rapidly generates text, image, and 3D modalities for enhanced early-stage design exploration. We show that using text as an intermediate modality outperforms direct sketch-to-3D baselines for generating diverse and manufacturable 3D models. We find limitations in current image-to-3D techniques, while noting the value of the text modality for user-feedback and iterative design augmentation.
Code (0)
등록된 구현이 없습니다.
Tasks
Image to 3DMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Sketch-to-Architecture: Generative AI-aided Architectural Design
Recently, the development of large-scale models has paved the way for various interdisciplinary research, including architecture. By using generative AI, we present a novel workflow that utilizes AI models to generate co…
Sketch2Code: Evaluating Vision-Language Models for Interactive Web Design Prototyping
Sketches are a natural and accessible medium for UI designers to conceptualize early-stage ideas. However, existing research on UI/UX automation often requires high-fidelity inputs like Figma designs or detailed screensh…
BenchmarkingStructural Design Recommendations in the Early Design Phase using Machine Learning
Structural engineering knowledge can be of significant importance to the architectural design team during the early design phase. However, architects and engineers do not typically work together during the conceptual pha…
BIG-bench Machine LearningWords as Bridges: Exploring Computational Support for Cross-Disciplinary Translation Work
Scholars often explore literature outside of their home community of study. This exploration process is frequently hampered by field-specific jargon. Past computational work often focuses on supporting translation work b…
TranslationWord EmbeddingsDeep Learning in a Computational Model for Conceptual Shifts in a Co-Creative Design System
This paper presents a computational model for conceptual shifts, based on a novelty metric applied to a vector representation generated through deep learning. This model is integrated into a co-creative design system, wh…
AI Agent