paper-with-me

홈 › Papers

Analysis of Different Losses for Deep Learning Image Colorization

2022-04-06 · Coloma Ballester, Aurélie Bugeau, Hernan Carrillo, Michaël Clément, Rémi Giraud, Lara Raad, Patricia Vitoria

Image colorization aims to add color information to a grayscale image in a realistic way. Recent methods mostly rely on deep learning strategies. While learning to automatically colorize an image, one can define well-suited objective functions related to the desired color output. Some of them are based on a specific type of error between the predicted image and ground truth one, while other losses rely on the comparison of perceptual properties. But, is the choice of the objective function that crucial, i.e., does it play an important role in the results? In this chapter, we aim to answer this question by analyzing the impact of the loss function on the estimated colorization results. To that goal, we review the different losses and evaluation metrics that are used in the literature. We then train a baseline network with several of the reviewed objective functions: classic L1 and L2 losses, as well as more complex combinations such as Wasserstein GAN and VGG-based LPIPS loss. Quantitative results show that the models trained with VGG-based LPIPS provide overall slightly better results for most evaluation metrics. Qualitative results exhibit more vivid colors when with Wasserstein GAN plus the L2 loss or again with the VGG-based LPIPS. Finally, the convenience of quantitative user studies is also discussed to overcome the difficulty of properly assessing on colorized images, notably for the case of old archive photographs where no ground truth is available.

📄 PDF Abstract BibTeX arXiv:2204.02980

Code (0)

등록된 구현이 없습니다.

Tasks

ColorizationDeep LearningImage Colorization

Methods 이 논문이 사용한 방법론

Colorization Colorization is a self-supervision approach that relies on colorization as the pretext task in order to learn image representations.

Similar Papers 제목 키워드 기반

Generative Probabilistic Image Colorization

2021-09-29 · Chie Furusawa, Shinya Kitaoka, Michael Li, Yuri Odagiri

We propose Generative Probabilistic Image Colorization, a diffusion-based generative process that trains a sequence of probabilistic models to reverse each step of noise corruption. Given a line-drawing image as input, o…

ColorizationConditional Image GenerationImage ColorizationImage Generation

Fully Automatic Video Colorization with Self-Regularization and Diversity

2019-08-04 · CVPR 2019 6 · Chenyang Lei, Qifeng Chen

We present a fully automatic approach to video colorization with self-regularization and diversity. Our model contains a colorization network for video frame colorization and a refinement network for spatiotemporal color…

ColorizationDiversity

Cycle-CNN for Colorization towards Real Monochrome-Color Camera Systems

2020-04-03 · AAAI Technical Track: Vision 2020 4 · Xuan Dong, Weixin Li, Xiaojie Wang, Yunhong Wang

Colorization in monochrome-color camera systems aims to colorize the gray image IG from the monochrome camera using the color image RC from the color camera as reference. Since monochrome cameras have better imaging qual…

Colorization

VCGAN: Video Colorization with Hybrid Generative Adversarial Network

2021-04-26 · Yuzhi Zhao, Lai-Man Po, Wing-Yin Yu, Yasar Abbas Ur Rehman 외

We propose a hybrid recurrent Video Colorization with Hybrid Generative Adversarial Network (VCGAN), an improved approach to video colorization using end-to-end learning. The VCGAN addresses two prevalent issues in the v…

ColorizationGenerative Adversarial NetworkImage Colorization

Two Decades of Colorization and Decolorization for Images and Videos

2022-04-28 · Shiguang Liu

Colorization is a computer-aided process, which aims to give color to a gray image or video. It can be used to enhance black-and-white images, including black-and-white photos, old-fashioned films, and scientific imaging…

ColorizationImage EnhancementImage SegmentationSemantic Segmentation+1