Style-Content Disentanglement in Language-Image Pretraining Representations for Zero-Shot Sketch-to-Image Synthesis
In this work, we propose and validate a framework to leverage language-image pretraining representations for training-free zero-shot sketch-to-image synthesis. We show that disentangled content and style representations can be utilized to guide image generators to employ them as sketch-to-image generators without (re-)training any parameters. Our approach for disentangling style and content entails a simple method consisting of elementary arithmetic assuming compositionality of information in representations of input sketches. Our results demonstrate that this approach is competitive with state-of-the-art instance-level open-domain sketch-to-image models, while only depending on pretrained off-the-shelf models and a fraction of the data.
Code (0)
등록된 구현이 없습니다.
Tasks
DisentanglementImage GenerationSimilar Papers 제목 키워드 기반
InfoStyler: Disentanglement Information Bottleneck for Artistic Style Transfer
Artistic style transfer aims to transfer the style of an artwork to a photograph while maintaining its original overall content. Many prior works focus on designing various transfer modules to transfer the style statisti…
DisentanglementRepresentation LearningStyle TransferMeasuring the Biases and Effectiveness of Content-Style Disentanglement
A recent spate of state-of-the-art semi- and un-supervised solutions disentangle and encode image "content" into a spatial tensor and image appearance or "style" into a vector, to achieve good performance in spatially eq…
DisentanglementImage-to-Image TranslationDiagonal Attention and Style-based GAN for Content-Style Disentanglement in Image Generation and Translation
One of the important research topics in image generative models is to disentangle the spatial contents and styles for their separate control. Although StyleGAN can generate content feature vectors from random noises, the…
DisentanglementImage GenerationTranslationContent-style disentangled representation for controllable artistic image stylization and generation
Controllable artistic image stylization and generation aims to render the content provided by text or image with the learned artistic style, where content and style decoupling is the key to achieve satisfactory results. …
DisentanglementImage StylizationRethinking Content and Style: Exploring Bias for Unsupervised Disentanglement
Content and style (C-S) disentanglement intends to decompose the underlying explanatory factors of objects into two independent subspaces. From the unsupervised disentanglement perspective, we rethink content and style a…
3D ReconstructionDisentanglementImage ReconstructionInductive Bias+2