Learning Representations for Automatic Colorization
We develop a fully automatic image colorization system. Our approach leverages recent advances in deep networks, exploiting both low-level and semantic representations. As many scene elements naturally appear according to multimodal color distributions, we train our model to predict per-pixel color histograms. This intermediate output can be used to automatically generate a color image, or further manipulated prior to image formation. On both fully and partially automatic colorization tasks, we outperform existing methods. We also explore colorization as a vehicle for self-supervised visual representation learning.
Code (3)
Tasks
ColorizationImage ColorizationRepresentation LearningSimilar Papers 제목 키워드 기반
Comicolorization: Semi-Automatic Manga Colorization
We developed "Comicolorization", a semi-automatic colorization system for manga images. Given a monochrome manga and reference images as inputs, our system generates a plausible color version of the manga. This is the fi…
ColorizationAutomatic Controllable Colorization via Imagination
We propose a framework for automatic colorization that allows for iterative editing and modifications. The core of our framework lies in an imagination module: by understanding the content within a grayscale image, we ut…
ColorizationImage GenerationFully Automatic Video Colorization with Self-Regularization and Diversity
We present a fully automatic approach to video colorization with self-regularization and diversity. Our model contains a colorization network for video frame colorization and a refinement network for spatiotemporal color…
ColorizationDiversityAudio-Infused Automatic Image Colorization by Exploiting Audio Scene Semantics
Automatic image colorization is inherently an ill-posed problem with uncertainty, which requires an accurate semantic understanding of scenes to estimate reasonable colors for grayscale images. Although recent interactio…
ColorizationImage ColorizationControlCol: Controllability in Automatic Speaker Video Colorization
Adding color to black-and-white speaker videos automatically is a highly desirable technique. It is an artistic process that requires interactivity with humans for the best results. Many existing automatic video coloriza…
ColorizationSSIM