Unsupervised Image Decomposition in Vector Layers
Deep image generation is becoming a tool to enhance artists and designers creativity potential. In this paper, we aim at making the generation process more structured and easier to interact with. Inspired by vector graphics systems, we propose a new deep image reconstruction paradigm where the outputs are composed from simple layers, defined by their color and a vector transparency mask. This presents a number of advantages compared to the commonly used convolutional network architectures. In particular, our layered decomposition allows simple user interaction, for example to update a given mask, or change the color of a selected layer. From a compact code, our architecture also generates vector images with a virtually infinite resolution, the color at each point in an image being a parametric function of its coordinates. We validate the efficiency of our approach by comparing reconstructions with state-of-the-art baselines given similar memory resources on CelebA and ImageNet datasets. Most importantly, we demonstrate several applications of our new image representation obtained in an unsupervised manner, including editing, vectorization and image search.
Code (0)
등록된 구현이 없습니다.
Tasks
Image GenerationImage ReconstructionImage RetrievalUnsupervised Image DecompositionVector GraphicsSimilar Papers 제목 키워드 기반
Towards Disentangling Latent Space for Unsupervised Semantic Face Editing
Facial attributes in StyleGAN generated images are entangled in the latent space which makes it very difficult to independently control a specific attribute without affecting the others. Supervised attribute editing requ…
AttributeImage Generation"Double-DIP": Unsupervised Image Decomposition via Coupled Deep-Image-Priors
Many seemingly unrelated computer vision tasks can be viewed as a special case of image decomposition into separate layers. For example, image segmentation (separation into foreground and background layers); transparent …
Image DehazingImage SegmentationSemantic SegmentationTransparency Separation+1"Double-DIP": Unsupervised Image Decomposition via Coupled Deep-Image-Priors
Many seemingly unrelated computer vision tasks can be viewed as a special case of image decomposition into separate layers. For example, image segmentation (separation into foreground and background layers); transparent…
Image DehazingImage SegmentationSemantic SegmentationTransparency Separation+1Leveraging Multi-view Image Sets for Unsupervised Intrinsic Image Decomposition and Highlight Separation
We present an unsupervised approach for factorizing object appearance into highlight, shading, and albedo layers, trained by multi-view real images. To do so, we construct a multi-view dataset by collecting numerous cust…
Intrinsic Image DecompositionObjectClair Obscur: an Illumination-Aware Method for Real-World Image Vectorization
Image vectorization aims to convert raster images into editable, scalable vector representations while preserving visual fidelity. Existing vectorization methods struggle to represent complex real-world images, often pro…