Diffusing Colors: Image Colorization with Text Guided Diffusion
The colorization of grayscale images is a complex and subjective task with significant challenges. Despite recent progress in employing large-scale datasets with deep neural networks, difficulties with controllability and visual quality persist. To tackle these issues, we present a novel image colorization framework that utilizes image diffusion techniques with granular text prompts. This integration not only produces colorization outputs that are semantically appropriate but also greatly improves the level of control users have over the colorization process. Our method provides a balance between automation and control, outperforming existing techniques in terms of visual quality and semantic coherence. We leverage a pretrained generative Diffusion Model, and show that we can finetune it for the colorization task without losing its generative power or attention to text prompts. Moreover, we present a novel CLIP-based ranking model that evaluates color vividness, enabling automatic selection of the most suitable level of vividness based on the specific scene semantics. Our approach holds potential particularly for color enhancement and historical image colorization.
Code (0)
등록된 구현이 없습니다.
Tasks
ColorizationImage ColorizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
DiffColor: Toward High Fidelity Text-Guided Image Colorization with Diffusion Models
Recent data-driven image colorization methods have enabled automatic or reference-based colorization, while still suffering from unsatisfactory and inaccurate object-level color control. To address these issues, we propo…
ColorizationImage ColorizationImage ReconstructionPixel-level Semantics Guided Image Colorization
While many image colorization algorithms have recently shown the capability of producing plausible color versions from gray-scale photographs, they still suffer from the problems of context confusion and edge color bleed…
ColorizationImage ColorizationSegmentationSemantic SegmentationAudio-Infused Automatic Image Colorization by Exploiting Audio Scene Semantics
Automatic image colorization is inherently an ill-posed problem with uncertainty, which requires an accurate semantic understanding of scenes to estimate reasonable colors for grayscale images. Although recent interactio…
ColorizationImage ColorizationTIC: Text-Guided Image Colorization
Image colorization is a well-known problem in computer vision. However, due to the ill-posed nature of the task, image colorization is inherently challenging. Though several attempts have been made by researchers to make…
ColorizationImage ColorizationPan-Sharpening with Color-Aware Perceptual Loss and Guided Re-Colorization
We present a novel color-aware perceptual (CAP) loss for learning the task of pan-sharpening. Our CAP loss is designed to focus on the deep features of a pre-trained VGG network that are more sensitive to spatial details…
Colorization