Learning Diverse Image Colorization
Colorization is an ambiguous problem, with multiple viable colorizations for a single grey-level image. However, previous methods only produce the single most probable colorization. Our goal is to model the diversity intrinsic to the problem of colorization and produce multiple colorizations that display long-scale spatial co-ordination. We learn a low dimensional embedding of color fields using a variational autoencoder (VAE). We construct loss terms for the VAE decoder that avoid blurry outputs and take into account the uneven distribution of pixel colors. Finally, we build a conditional model for the multi-modal distribution between grey-level image and the color field embeddings. Samples from this conditional model result in diverse colorization. We demonstrate that our method obtains better diverse colorizations than a standard conditional variational autoencoder (CVAE) model, as well as a recently proposed conditional generative adversarial network (cGAN).
Code (1)
Tasks
ColorizationDecoderDiversityGenerative Adversarial NetworkImage ColorizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Style-Structure Disentangled Features and Normalizing Flows for Diverse Icon Colorization
In this study, we present a colorization network that generates flat-color icons according to given sketches and semantic colorization styles. Specifically, our network contains a style-structure disentangled coloriz…
ColorizationDecoderDiversityImage-to-Image TranslationTowards Photorealistic Colorization by Imagination
We present a novel approach to automatic image colorization by imitating the imagination process of human experts. Our imagination module is designed to generate color images that are context-correlated with black-and-wh…
ColorizationImage ColorizationImage GenerationTowards Vivid and Diverse Image Colorization with Generative Color Prior
Colorization has attracted increasing interest in recent years. Classic reference-based methods usually rely on external color images for plausible results. A large image database or online search engine is inevitably re…
ColorizationImage ColorizationBigColor: Colorization using a Generative Color Prior for Natural Images
For realistic and vivid colorization, generative priors have recently been exploited. However, such generative priors often fail for in-the-wild complex images due to their limited representation space. In this paper, we…
ColorizationColorization Transformer
We present the Colorization Transformer, a novel approach for diverse high fidelity image colorization based on self-attention. Given a grayscale image, the colorization proceeds in three steps. We first use a conditiona…
ColorizationImage Colorization