paper-with-me

홈 › Papers

Optimizing CAD Models with Latent Space Manipulation

2023-03-09 · Jannes Elstner, Raoul G. C. Schönhof, Steffen Tauber, Marco F Huber

When it comes to the optimization of CAD models in the automation domain, neural networks currently play only a minor role. Optimizing abstract features such as automation capability is challenging, since they can be very difficult to simulate, are too complex for rule-based systems, and also have little to no data available for machine-learning methods. On the other hand, image manipulation methods that can manipulate abstract features in images such as StyleCLIP have seen much success. They rely on the latent space of pretrained generative adversarial networks, and could therefore also make use of the vast amount of unlabeled CAD data. In this paper, we show that such an approach is also suitable for optimizing abstract automation-related features of CAD parts. We achieved this by extending StyleCLIP to work with CAD models in the form of voxel models, which includes using a 3D StyleGAN and a custom classifier. Finally, we demonstrate the ability of our system for the optimiziation of automation-related features by optimizing the grabability of various CAD models. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/) Peer review under the responsibility of the scientific committee of the 33rd CIRP Design Conference.

📄 PDF Abstract BibTeX arXiv:2303.12739

Code (1)

RaoulusHPC/KiMont_StyleGAN3D 공식 구현 tf

Tasks

Image Manipulation

Methods 이 논문이 사용한 방법론

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
R1 Regularization R_INLINE_MATH_1 Regularization is a regularization technique and gradient penalty for training [generative adversarial…
HuMan(Expedia)||How do I get a human at Expedia? How do I get a human at Expedia? How Do I Get a Human at Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Real-Time Help & Exclusive…
Adaptive Instance Normalization 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Feedforward Network A Feedforward Network, or a Multilayer Perceptron (MLP), is a neural network with solely densely connected layers. This is the classic neural network architecture of the…
StyleGAN 설명 없음

Similar Papers 제목 키워드 기반

Cycle-Consistent Inverse GAN for Text-to-Image Synthesis

2021-08-03 · Hao Wang, Guosheng Lin, Steven C. H. Hoi, Chunyan Miao

This paper investigates an open research task of text-to-image synthesis for automatically generating or manipulating images from text descriptions. Prevailing methods mainly use the text as conditions for GAN generation…

DiversityImage GenerationImage ManipulationText to Image Generation+1

Semantic Latent Decomposition with Normalizing Flows for Face Editing

2023-09-11 · Binglei Li, Zhizhong Huang, Hongming Shan, Junping Zhang

Navigating in the latent space of StyleGAN has shown effectiveness for face editing. However, the resulting methods usually encounter challenges in complicated navigation due to the entanglement among different attribute…

Enabling Visual Action Planning for Object Manipulation through Latent Space Roadmap

2021-03-03 · Martina Lippi, Petra Poklukar, Michael C. Welle, Anastasia Varava 외

We present a framework for visual action planning of complex manipulation tasks with high-dimensional state spaces, focusing on manipulation of deformable objects. We propose a Latent Space Roadmap (LSR) for task plannin…

Task Planning

Latent Space Roadmap for Visual Action Planning of Deformable and Rigid Object Manipulation

2020-03-19 · Martina Lippi, Petra Poklukar, Michael C. Welle, Anastasiia Varava 외

We present a framework for visual action planning of complex manipulation tasks with high-dimensional state spaces such as manipulation of deformable objects. Planning is performed in a low-dimensional latent state space…

One Model to Edit Them All: Free-Form Text-Driven Image Manipulation with Semantic Modulations

2022-10-14 · Yiming Zhu, Hongyu Liu, Yibing Song, Ziyang Yuan 외

Free-form text prompts allow users to describe their intentions during image manipulation conveniently. Based on the visual latent space of StyleGAN[21] and text embedding space of CLIP[34], studies focus on how to map t…

AllAttributeFormImage Manipulation