paper-with-me

홈 › Papers

Color2Embed: Fast Exemplar-Based Image Colorization using Color Embeddings

2021-06-15 · Hengyuan Zhao, Wenhao Wu, Yihao Liu, Dongliang He

In this paper, we present a fast exemplar-based image colorization approach using color embeddings named Color2Embed. Generally, due to the difficulty of obtaining input and ground truth image pairs, it is hard to train a exemplar-based colorization model with unsupervised and unpaired training manner. Current algorithms usually strive to achieve two procedures: i) retrieving a large number of reference images with high similarity for preparing training dataset, which is inevitably time-consuming and tedious; ii) designing complicated modules to transfer the colors of the reference image to the target image, by calculating and leveraging the deep semantic correspondence between them (e.g., non-local operation), which is computationally expensive during testing. Contrary to the previous methods, we adopt a self-augmented self-reference learning scheme, where the reference image is generated by graphical transformations from the original colorful one whereby the training can be formulated in a paired manner. Second, in order to reduce the process time, our method explicitly extracts the color embeddings and exploits a progressive style feature Transformation network, which injects the color embeddings into the reconstruction of the final image. Such design is much more lightweight and intelligible, achieving appealing performance with fast processing speed.

📄 PDF Abstract BibTeX arXiv:2106.08017

Code (3)

zhaohengyuan1/Color2Style 공식 구현 pytorch
Kwentar/Color2Embed_pytorch pytorch
zhaohengyuan1/Color2Embed pytorch

Tasks

ColorizationImage ColorizationSemantic correspondence

Methods 이 논문이 사용한 방법론

Colorization Colorization is a self-supervision approach that relies on colorization as the pretext task in order to learn image representations.

Similar Papers 제목 키워드 기반

Stylization-Based Architecture for Fast Deep Exemplar Colorization

2020-06-01 · CVPR 2020 6 · Zhongyou Xu, Tingting Wang, Faming Fang, Yun Sheng 외

Exemplar-based colorization aims to add colors to a grayscale image guided by a content related reference im- age. Existing methods are either sensitive to the selection of reference images (content, position) or extreme…

ColorizationImage Stylization

Semantic-Sparse Colorization Network for Deep Exemplar-based Colorization

2021-12-02 · Yunpeng Bai, Chao Dong, Zenghao Chai, Andong Wang 외

Exemplar-based colorization approaches rely on reference image to provide plausible colors for target gray-scale image. The key and difficulty of exemplar-based colorization is to establish an accurate correspondence bet…

Colorization

BiSTNet: Semantic Image Prior Guided Bidirectional Temporal Feature Fusion for Deep Exemplar-based Video Colorization

2022-12-05 · Yixin Yang, Zhongzheng Peng, Xiaoyu Du, Zhulin Tao 외

How to effectively explore the colors of reference exemplars and propagate them to colorize each frame is vital for exemplar-based video colorization. In this paper, we present an effective BiSTNet to explore colors of r…

ColorizationSemantic correspondence

Deep Exemplar-based Colorization

2018-07-17 · Mingming He, Dong-Dong Chen, Jing Liao, Pedro V. Sander 외

We propose the first deep learning approach for exemplar-based local colorization. Given a reference color image, our convolutional neural network directly maps a grayscale image to an output colorized image. Rather than…

ColorizationImage RetrievalRetrieval

Exemplar-Based Image Colorization with A Learning Framework

2022-09-13 · Zhenfeng Xue, Jiandang Yang, Jie Ren, Yong liu

Image learning and colorization are hot spots in multimedia domain. Inspired by the learning capability of humans, in this paper, we propose an automatic colorization method with a learning framework. This method can be …

ColorizationImage Colorization