Generative Pre-Trained Transformer for Design Concept Generation: An Exploration

2021-11-16 · Qihao Zhu, Jianxi Luo

Novel concepts are essential for design innovation and can be generated with the aid of data stimuli and computers. However, current generative design algorithms focus on diagrammatic or spatial concepts that are either too abstract to understand or too detailed for early phase design exploration. This paper explores the uses of generative pre-trained transformers (GPT) for natural language design concept generation. Our experiments involve the use of GPT-2 and GPT-3 for different creative reasonings in design tasks. Both show reasonably good performance for verbal design concept generation.

📄 PDF Abstract BibTeX arXiv:2111.08489

Code (0)

등록된 구현이 없습니다.

Tasks

Novel Concepts

Methods 이 논문이 사용한 방법론

15 Ways to Contact How can i speak to someone at Delta Airlines 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Adam 설명 없음

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Discriminative Fine-Tuning Discriminative Fine-Tuning is a fine-tuning strategy that is used for ULMFiT type models. Instead of using the same learning rate…

Generative Transformers for Design Concept Generation

2022-11-07 · Qihao Zhu, Jianxi Luo

Generating novel and useful concepts is essential during the early design stage to explore a large variety of design opportunities, which usually requires advanced design thinking ability and a wide range of knowledge fr…

Retrieval Text Generation

Biologically Inspired Design Concept Generation Using Generative Pre-Trained Transformers

2022-12-26 · Qihao Zhu, Xinyu Zhang, Jianxi Luo

Biological systems in nature have evolved for millions of years to adapt and survive the environment. Many features they developed can be inspirational and beneficial for solving technical problems in modern industries. …

Language Modelling

EraseAnything++: Enabling Concept Erasure in Rectified Flow Transformers Leveraging Multi-Object Optimization

2026-03-01 · Zhaoxin Fan, Nanxiang Jiang, Daiheng Gao, Shiji Zhou 외 arxiv

Removing undesired concepts from large-scale text-to-image (T2I) and text-to-video (T2V) diffusion models while preserving overall generative quality remains a major challenge, particularly as modern models such as Stabl…

Video Generation

Generative Pre-Trained Transformers for Biologically Inspired Design

2022-03-31 · Qihao Zhu, Xinyu Zhang, Jianxi Luo

Language Modelling

3DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models

2023-01-26 · Biao Zhang, Jiapeng Tang, Matthias Niessner, Peter Wonka

We introduce 3DShape2VecSet, a novel shape representation for neural fields designed for generative diffusion models. Our shape representation can encode 3D shapes given as surface models or point clouds, and represents …

3D Shape Representation Point Cloud Completion