Coloring with Words: Guiding Image Colorization Through Text-based Palette Generation
This paper proposes a novel approach to generate multiple color palettes that reflect the semantics of input text and then colorize a given grayscale image according to the generated color palette. In contrast to existing approaches, our model can understand rich text, whether it is a single word, a phrase, or a sentence, and generate multiple possible palettes from it. For this task, we introduce our manually curated dataset called Palette-and-Text (PAT). Our proposed model called Text2Colors consists of two conditional generative adversarial networks: the text-to-palette generation networks and the palette-based colorization networks. The former captures the semantics of the text input and produce relevant color palettes. The latter colorizes a grayscale image using the generated color palette. Our evaluation results show that people preferred our generated palettes over ground truth palettes and that our model can effectively reflect the given palette when colorizing an image.
Code (1)
Tasks
ColorizationImage ColorizationSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Grayscale Image Colorization with GAN and CycleGAN in Different Image Domain
Automatic colorization of grayscale image has been a challenging task. Previous research have applied supervised methods in conquering this problem [ 1]. In this paper, we reproduces a GAN-based coloring model, and exper…
ColorizationImage ColorizationColorization Transformer
We present the Colorization Transformer, a novel approach for diverse high fidelity image colorization based on self-attention. Given a grayscale image, the colorization proceeds in three steps. We first use a conditiona…
ColorizationImage ColorizationAutomatic Controllable Colorization via Imagination
We propose a framework for automatic colorization that allows for iterative editing and modifications. The core of our framework lies in an imagination module: by understanding the content within a grayscale image, we ut…
ColorizationImage GenerationColor and Frequency Correction for Image Colorization
The project has carried out the re-optimization of image coloring in accordance with the existing Autocolorization direction model DDColor. For the experiments on the existing weights of DDColor, we found that it has lim…
Image ColorizationFocusing on Persons: Colorizing Old Images Learning from Modern Historical Movies
In industry, there exist plenty of scenarios where old gray photos need to be automatically colored, such as video sites and archives. In this paper, we present the HistoryNet focusing on historical person's diverse high…
ClassificationColorizationImage ColorizationSemantic Parsing