paper-with-me

Papers

Deep Exemplar-based Video Colorization

2019-06-24 · CVPR 2019 6 · Bo Zhang, Mingming He, Jing Liao, Pedro V. Sander, Lu Yuan, Amine Bermak, Dong Chen

This paper presents the first end-to-end network for exemplar-based video colorization. The main challenge is to achieve temporal consistency while remaining faithful to the reference style. To address this issue, we introduce a recurrent framework that unifies the semantic correspondence and color propagation steps. Both steps allow a provided reference image to guide the colorization of every frame, thus reducing accumulated propagation errors. Video frames are colorized in sequence based on the colorization history, and its coherency is further enforced by the temporal consistency loss. All of these components, learned end-to-end, help produce realistic videos with good temporal stability. Experiments show our result is superior to the state-of-the-art methods both quantitatively and qualitatively.

📄 PDF Abstract BibTeX arXiv:1906.09909

Code (1)

zhangmozhe/video-colorization 공식 구현 pytorch

Tasks

ColorizationSemantic correspondence

Methods 이 논문이 사용한 방법론

Colorization Colorization is a self-supervision approach that relies on colorization as the pretext task in order to learn image representations.

Similar Papers 제목 키워드 기반

BiSTNet: Semantic Image Prior Guided Bidirectional Temporal Feature Fusion for Deep Exemplar-based Video Colorization

2022-12-05 · Yixin Yang, Zhongzheng Peng, Xiaoyu Du, Zhulin Tao 외

How to effectively explore the colors of reference exemplars and propagate them to colorize each frame is vital for exemplar-based video colorization. In this paper, we present an effective BiSTNet to explore colors of r…

ColorizationSemantic correspondence

SwinTExCo: Exemplar-based video colorization using Swin Transformer

2025-01-15 · Expert Systems with Applications 2025 1 · Duong Thanh Tran, Nguyen Doan Hieu Nguyen, Trung Thanh Pham, Phuong-Nam Tran 외

Video colorization represents a compelling domain within the field of Computer Vision. The traditional approach in this field relies on Convolutional Neural Networks (CNNs) to extract features from each video frame and e…

ColorizationVideo Restoration

Deep Exemplar-based Colorization

2018-07-17 · Mingming He, Dong-Dong Chen, Jing Liao, Pedro V. Sander 외

We propose the first deep learning approach for exemplar-based local colorization. Given a reference color image, our convolutional neural network directly maps a grayscale image to an output colorized image. Rather than…

ColorizationImage RetrievalRetrieval

Exemplar-based Video Colorization with Long-term Spatiotemporal Dependency

2023-03-27 · Siqi Chen, Xueming Li, Xianlin Zhang, Mingdao Wang 외

Exemplar-based video colorization is an essential technique for applications like old movie restoration. Although recent methods perform well in still scenes or scenes with regular movement, they always lack robustness i…

Colorization

L-C4: Language-Based Video Colorization for Creative and Consistent Color

2024-10-07 · Zheng Chang, Shuchen Weng, Huan Ouyang, Yu Li 외

Automatic video colorization is inherently an ill-posed problem because each monochrome frame has multiple optional color candidates. Previous exemplar-based video colorization methods restrict the user's imagination due…

ColorizationImage Colorization