paper-with-me

홈 › Papers

Exemplar-Based Image Colorization with A Learning Framework

2022-09-13 · Zhenfeng Xue, Jiandang Yang, Jie Ren, Yong liu

Image learning and colorization are hot spots in multimedia domain. Inspired by the learning capability of humans, in this paper, we propose an automatic colorization method with a learning framework. This method can be viewed as a hybrid of exemplar-based and learning-based method, and it decouples the colorization process and learning process so as to generate various color styles for the same gray image. The matching process in the exemplar-based colorization method can be regarded as a parameterized function, and we employ a large amount of color images as the training samples to fit the parameters. During the training process, the color images are the ground truths, and we learn the optimal parameters for the matching process by minimizing the errors in terms of the parameters for the matching function. To deal with images with various compositions, a global feature is introduced, which can be used to classify the images with respect to their compositions, and then learn the optimal matching parameters for each image category individually. What's more, a spatial consistency based post-processing is design to smooth the extracted color information from the reference image to remove matching errors. Extensive experiments are conducted to verify the effectiveness of the method, and it achieves comparable performance against the state-of-the-art colorization algorithms.

📄 PDF Abstract BibTeX arXiv:2209.05775

Code (0)

등록된 구현이 없습니다.

Tasks

ColorizationImage Colorization

Methods 이 논문이 사용한 방법론

Colorization Colorization is a self-supervision approach that relies on colorization as the pretext task in order to learn image representations.

Similar Papers 제목 키워드 기반

Stylization-Based Architecture for Fast Deep Exemplar Colorization

2020-06-01 · CVPR 2020 6 · Zhongyou Xu, Tingting Wang, Faming Fang, Yun Sheng 외

Exemplar-based colorization aims to add colors to a grayscale image guided by a content related reference im- age. Existing methods are either sensitive to the selection of reference images (content, position) or extreme…

ColorizationImage Stylization

Semantic-Sparse Colorization Network for Deep Exemplar-based Colorization

2021-12-02 · Yunpeng Bai, Chao Dong, Zenghao Chai, Andong Wang 외

Exemplar-based colorization approaches rely on reference image to provide plausible colors for target gray-scale image. The key and difficulty of exemplar-based colorization is to establish an accurate correspondence bet…

Colorization

Deep Exemplar-based Colorization

2018-07-17 · Mingming He, Dong-Dong Chen, Jing Liao, Pedro V. Sander 외

We propose the first deep learning approach for exemplar-based local colorization. Given a reference color image, our convolutional neural network directly maps a grayscale image to an output colorized image. Rather than…

ColorizationImage RetrievalRetrieval

Deep Exemplar-based Video Colorization

2019-06-24 · CVPR 2019 6 · Bo Zhang, Mingming He, Jing Liao, Pedro V. Sander 외

This paper presents the first end-to-end network for exemplar-based video colorization. The main challenge is to achieve temporal consistency while remaining faithful to the reference style. To address this issue, we int…

ColorizationSemantic correspondence

BiSTNet: Semantic Image Prior Guided Bidirectional Temporal Feature Fusion for Deep Exemplar-based Video Colorization

2022-12-05 · Yixin Yang, Zhongzheng Peng, Xiaoyu Du, Zhulin Tao 외

How to effectively explore the colors of reference exemplars and propagate them to colorize each frame is vital for exemplar-based video colorization. In this paper, we present an effective BiSTNet to explore colors of r…

ColorizationSemantic correspondence