Multi-scale HSV Color Feature Embedding for High-fidelity NIR-to-RGB Spectrum Translation
The NIR-to-RGB spectral domain translation is a formidable task due to the inherent spectral mapping ambiguities within NIR inputs and RGB outputs. Thus, existing methods fail to reconcile the tension between maintaining texture detail fidelity and achieving diverse color variations. In this paper, we propose a Multi-scale HSV Color Feature Embedding Network (MCFNet) that decomposes the mapping process into three sub-tasks, including NIR texture maintenance, coarse geometry reconstruction, and RGB color prediction. Thus, we propose three key modules for each corresponding sub-task: the Texture Preserving Block (TPB), the HSV Color Feature Embedding Module (HSV-CFEM), and the Geometry Reconstruction Module (GRM). These modules contribute to our MCFNet methodically tackling spectral translation through a series of escalating resolutions, progressively enriching images with color and texture fidelity in a scale-coherent fashion. The proposed MCFNet demonstrates substantial performance gains over the NIR image colorization task. Code is released at: https://github.com/AlexYangxx/MCFNet.
Code (1)
Tasks
ColorizationImage ColorizationTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Multi-scale Progressive Feature Embedding for Accurate NIR-to-RGB Spectral Domain Translation
NIR-to-RGB spectral domain translation is a challenging task due to the mapping ambiguities, and existing methods show limited learning capacities. To address these challenges, we propose to colorize NIR images via a mul…
ColorizationImage ColorizationTranslationInvertible Grayscale via Dual Features Ensemble
Grayscale image colorization is known as an ill-posed problem because of the imbalanced matching between intensity and color values. Even given prior hints about the original color image, existing colorization methods …
ColorizationImage ColorizationMultiColor: Image Colorization by Learning from Multiple Color Spaces
Deep networks have shown impressive performance in the image restoration tasks, such as image colorization. However, we find that previous approaches rely on the digital representation from single color model with a spec…
ColorizationDecoderImage ColorizationImage RestorationLearning Hierarchical Color Guidance for Depth Map Super-Resolution
Color information is the most commonly used prior knowledge for depth map super-resolution (DSR), which can provide high-frequency boundary guidance for detail restoration. However, its role and functionality in DSR have…
Depth Map Super-ResolutionSuper-ResolutionUnderwater Image Enhancement via Medium Transmission-Guided Multi-Color Space Embedding
Underwater images suffer from color casts and low contrast due to wavelength- and distance-dependent attenuation and scattering. To solve these two degradation issues, we present an underwater image enhancement network v…
DecoderDiversityImage EnhancementUnderwater Image Restoration