Joint Intensity-Gradient Guided Generative Modeling for Colorization
This paper proposes an iterative generative model for solving the automatic colorization problem. Although previous researches have shown the capability to generate plausible color, the edge color overflow and the requirement of the reference images still exist. The starting point of the unsupervised learning in this study is the ob?servation that the gradient map possesses latent infor?mation of the image. Therefore, the inference process of the generative modeling is conducted in joint intensity-gradient domain. Specifically, a set of intensity-gradient formed high-dimensional tensors, as the network input, are used to train a powerful noise conditional score network at the training phase. Furthermore, the joint intensity-gradient constraint in data-fidelity term is proposed to limit the degree of freedom within generative model at the iterative colorization stage, and it is conducive to edge-preserving. Extensive experiments demonstrated that the system out?performed state-of-the-art methods whether in quantitative comparisons or user study.
Code (7)
Tasks
ColorizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Dual-Phase Playtime-guided Recommendation: Interest Intensity Exploration and Multimodal Random Walks
The explosive growth of the video game industry has created an urgent need for recommendation systems that can scale with expanding catalogs and maintain user engagement. While prior work has explored accuracy and divers…
Recommendation SystemsSemantic SimilarityCopula Ordinal Regression for Joint Estimation of Facial Action Unit Intensity
Joint modeling of the intensity of facial action units (AUs) from face images is challenging due to the large number of AUs (30+) and their intensity levels (6). This is in part due to the lack of suitable models that c…
regressionSensitivity Analysis for Climate Science with Generative Flow Models
Sensitivity analysis is a cornerstone of climate science, essential for understanding phenomena ranging from storm intensity to long-term climate feedbacks. However, computing these sensitivities using traditional physic…
EgoFlow: Gradient-Guided Flow Matching for Egocentric 6DoF Object Motion Generation
Understanding and predicting object motion from egocentric video is fundamental to embodied perception and interaction. However, generating physically consistent 6DoF trajectories remains challenging due to occlusions, f…
Collision AvoidanceBreaking Degradation Coupling: A Structural Entropy Guided Decoupled Framework and Benchmark for Infrared Enhancement
Thermal infrared image enhancement aims to restore high-quality images from complex compound degradations. Existing all-in-one approaches typically employ a single shared backbone to handle diverse degradations, which ca…
Image Enhancement