A Physical Model-Guided Framework for Underwater Image Enhancement and Depth Estimation
Due to the selective absorption and scattering of light by diverse aquatic media, underwater images usually suffer from various visual degradations. Existing underwater image enhancement (UIE) approaches that combine underwater physical imaging models with neural networks often fail to accurately estimate imaging model parameters such as depth and veiling light, resulting in poor performance in certain scenarios. To address this issue, we propose a physical model-guided framework for jointly training a Deep Degradation Model (DDM) with any advanced UIE model. DDM includes three well-designed sub-networks to accurately estimate various imaging parameters: a veiling light estimation sub-network, a factors estimation sub-network, and a depth estimation sub-network. Based on the estimated parameters and the underwater physical imaging model, we impose physical constraints on the enhancement process by modeling the relationship between underwater images and desired clean images, i.e., outputs of the UIE model. Moreover, while our framework is compatible with any UIE model, we design a simple yet effective fully convolutional UIE model, termed UIEConv. UIEConv utilizes both global and local features for image enhancement through a dual-branch structure. UIEConv trained within our framework achieves remarkable enhancement results across diverse underwater scenes. Furthermore, as a byproduct of UIE, the trained depth estimation sub-network enables accurate underwater scene depth estimation. Extensive experiments conducted in various real underwater imaging scenarios, including deep-sea environments with artificial light sources, validate the effectiveness of our framework and the UIEConv model.
Code (1)
Tasks
Depth EstimationImage EnhancementUIESimilar Papers 제목 키워드 기반
SyreaNet: A Physically Guided Underwater Image Enhancement Framework Integrating Synthetic and Real Images
Underwater image enhancement (UIE) is vital for high-level vision-related underwater tasks. Although learning-based UIE methods have made remarkable achievements in recent years, it's still challenging for them to consis…
Domain AdaptationImage EnhancementImage GenerationUIEPUGAN: Physical Model-Guided Underwater Image Enhancement Using GAN with Dual-Discriminators
Due to the light absorption and scattering induced by the water medium, underwater images usually suffer from some degradation problems, such as low contrast, color distortion, and blurring details, which aggravate the d…
Image EnhancementQuantizationUIEA Generalized Physical-knowledge-guided Dynamic Model for Underwater Image Enhancement
Underwater images often suffer from color distortion and low contrast resulting in various image types, due to the scattering and absorption of light by water. While it is difficult to obtain high-quality paired training…
Image EnhancementUnderwater Image Enhancement via Medium Transmission-Guided Multi-Color Space Embedding
Underwater images suffer from color casts and low contrast due to wavelength- and distance-dependent attenuation and scattering. To solve these two degradation issues, we present an underwater image enhancement network v…
DecoderDiversityImage EnhancementUnderwater Image RestorationUnderwater Variable Zoom: Depth-Guided Perception Network for Underwater Image Enhancement
Underwater scenes intrinsically involve degradation problems owing to heterogeneous ocean elements. Prevailing underwater image enhancement (UIE) methods stick to straightforward feature modeling to learn the mapping fun…
Depth EstimationImage EnhancementUIE