Feature Disentanglement in generating three-dimensional structure from two-dimensional slice with sliceGAN
Deep generative models are known to be able to model arbitrary probability distributions. Among these, a recent deep generative model, dubbed sliceGAN, proposed a new way of using the generative adversarial network (GAN) to capture the micro-structural characteristics of a two-dimensional (2D) slice and generate three-dimensional (3D) volumes with similar properties. While 3D micrographs are largely beneficial in simulating diverse material behavior, they are often much harder to obtain than their 2D counterparts. Hence, sliceGAN opens up many interesting directions of research by learning the representative distribution from 2D slices, and transferring the learned knowledge to generate arbitrary 3D volumes. However, one limitation of sliceGAN is that latent space steering is not possible. Hence, we combine sliceGAN with AdaIN to endow the model with the ability to disentangle the features and control the synthesis.
Code (0)
등록된 구현이 없습니다.
Tasks
DisentanglementGenerative Adversarial NetworkSimilar Papers 제목 키워드 기반
Disentanglement with Hyperspherical Latent Spaces using Diffusion Variational Autoencoders
A disentangled representation of a data set should be capable of recovering the underlying factors that generated it. One question that arises is whether using Euclidean space for latent variable models can produce a dis…
DisentanglementDisentanglement with Hyperspherical Latent Spaces using Diffusion Variational Autoencoders
A disentangled representation of a data set should be capable of recovering the underlying factors that generated it. One question that arises is whether using Euclidean space for latent variable models can produce a dis…
DisentanglementNeRF-AD: Neural Radiance Field with Attention-based Disentanglement for Talking Face Synthesis
Talking face synthesis driven by audio is one of the current research hotspots in the fields of multidimensional signal processing and multimedia. Neural Radiance Field (NeRF) has recently been brought to this research f…
DisentanglementFace GenerationNeRFZero-Shot Sketch-Based Image Retrieval with Structure-aware Asymmetric Disentanglement
The goal of Sketch-Based Image Retrieval (SBIR) is using free-hand sketches to retrieve images of the same category from a natural image gallery. However, SBIR requires all test categories to be seen during training, whi…
DisentanglementImage RetrievalRetrievalSketch-Based Image Retrieval+1CAMS: Towards Compositional Zero-Shot Learning via Gated Cross-Attention and Multi-Space Disentanglement
Compositional zero-shot learning (CZSL) aims to learn the concepts of attributes and objects in seen compositions and to recognize their unseen compositions. Most Contrastive Language-Image Pre-training (CLIP)-based CZSL…
Compositional Zero-Shot Learning