Specularity Factorization for Low-Light Enhancement
We present a new additive image factorization technique that treats images to be composed of multiple latent specular components which can be simply estimated recursively by modulating the sparsity during decomposition. Our model-driven {\em RSFNet} estimates these factors by unrolling the optimization into network layers requiring only a few scalars to be learned. The resultant factors are interpretable by design and can be fused for different image enhancement tasks via a network or combined directly by the user in a controllable fashion. Based on RSFNet, we detail a zero-reference Low Light Enhancement (LLE) application trained without paired or unpaired supervision. Our system improves the state-of-the-art performance on standard benchmarks and achieves better generalization on multiple other datasets. We also integrate our factors with other task specific fusion networks for applications like deraining, deblurring and dehazing with negligible overhead thereby highlighting the multi-domain and multi-task generalizability of our proposed RSFNet. The code and data is released for reproducibility on the project homepage.
Code (0)
등록된 구현이 없습니다.
Tasks
DeblurringImage EnhancementRain RemovalSimilar Papers 제목 키워드 기반
A Multiple-View Geometric Model for Specularity Prediction on General Curved Surfaces
Specularity prediction is essential to many computer vision applications, giving important visual cues usable in Augmented Reality (AR), Simultaneous Localisation and Mapping (SLAM), 3D reconstruction and material modeli…
3D ReconstructionPredictionScene UnderstandingDichromatic Model Based Temporal Color Constancy for AC Light Sources
Existing dichromatic color constancy approach commonly requires a number of spatial pixels which have high specularity. In this paper, we propose a novel approach to estimate the illuminant chromaticity of AC light sourc…
Color ConstancyLIGHTS: LIGHT Specularity Dataset for specular detection in Multi-view
Specular highlights are commonplace in images, however, methods for detecting them and in turn removing the phenomenon are particularly challenging. A reason for this, is due to the difficulty of creating a dataset for t…
Highlight DetectionMulti-times Monte Carlo Rendering for Inter-reflection Reconstruction
Inverse rendering methods have achieved remarkable performance in reconstructing high-fidelity 3D objects with disentangled geometries, materials, and environmental light. However, they still face huge challenges in refl…
DisentanglementInverse RenderingSurface ReconstructionJoint network for specular highlight detection and adversarial generation of specular-free images trained with polarimetric data
Specular highlights in images pose a significant challenge in algorithms for image segmentation, object detection and other image-based decision-making systems. However, most systems ignore this particular scenario and n…
Decision MakingGenerative Adversarial NetworkHighlight Detectionhighlight removal+5