Let there be color!: joint end-to-end learning of global and local image priors for automatic image colorization with simultaneous classification
We present a novel technique to automatically colorize grayscale images that combines both global priors and local image features. Based on Convolutional Neural Networks, our deep network features a fusion layer that allows us to elegantly merge local information dependent on small image patches with global priors computed using the entire image. The entire framework, including the global and local priors as well as the colorization model, is trained in an end-to-end fashion. Furthermore, our architecture can process images of any resolution, unlike most existing approaches based on CNN. We leverage an existing large-scale scene classification database to train our model, exploiting the class labels of the dataset to more efficiently and discriminatively learn the global priors. We validate our approach with a user study and compare against the state of the art, where we show significant improvements. Furthermore, we demonstrate our method extensively on many different types of images, including black-and-white photography from over a hundred years ago, and show realistic colorizations.
Code (3)
Tasks
ColorizationImage ColorizationScene ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Progressive Color Transfer with Dense Semantic Correspondences
We propose a new algorithm for color transfer between images that have perceptually similar semantic structures. We aim to achieve a more accurate color transfer that leverages semantically-meaningful dense correspondenc…
Towards Efficient SDRTV-to-HDRTV by Learning from Image Formation
Modern displays can render video content with high dynamic range (HDR) and wide color gamut (WCG). However, most resources are still in standard dynamic range (SDR). Therefore, transforming existing SDR content into the …
4kInteractive Deep Colorization With Simultaneous Global and Local Inputs
Colorization methods using deep neural networks have become a recent trend. However, most of them do not allow user inputs, or only allow limited user inputs (only global inputs or only local inputs), to control the outp…
ColorizationMulti-Feature Fusion-based Scene Classification Framework for HSR Images
To realize high-accuracy classification of high spatial resolution (HSR) images, this letter proposes a new multi-feature fusion-based scene classification framework (MF2SCF) by fusing local, global, and color features o…
ClassificationScene ClassificationPerson Re-identification Method Based on Color Attack and Joint Defence
The main challenges of ReID is the intra-class variations caused by color deviation under different camera conditions. Simultaneously, we find that most of the existing adversarial metric attacks are realized by interfer…
Adversarial DefenseMetric LearningPerson Re-Identification