HybrUR: A Hybrid Physical-Neural Solution for Unsupervised Underwater Image Restoration
Robust vision restoration of underwater images remains a challenge. Owing to the lack of well-matched underwater and in-air images, unsupervised methods based on the cyclic generative adversarial framework have been widely investigated in recent years. However, when using an end-to-end unsupervised approach with only unpaired image data, mode collapse could occur, and the color correction of the restored images is usually poor. In this paper, we propose a data- and physics-driven unsupervised architecture to perform underwater image restoration from unpaired underwater and in-air images. For effective color correction and quality enhancement, an underwater image degeneration model must be explicitly constructed based on the optically unambiguous physics law. Thus, we employ the Jaffe-McGlamery degeneration theory to design a generator and use neural networks to model the process of underwater visual degeneration. Furthermore, we impose physical constraints on the scene depth and degeneration factors for backscattering estimation to avoid the vanishing gradient problem during the training of the hybrid physical-neural model. Experimental results show that the proposed method can be used to perform high-quality restoration of unconstrained underwater images without supervision. On multiple benchmarks, the proposed method outperforms several state-of-the-art supervised and unsupervised approaches. We demonstrate that our method yields encouraging results in real-world applications.
Code (0)
등록된 구현이 없습니다.
Tasks
Image RestorationUnderwater Image RestorationSimilar Papers 제목 키워드 기반
WaterGAN: Unsupervised Generative Network to Enable Real-time Color Correction of Monocular Underwater Images
This paper reports on WaterGAN, a generative adversarial network (GAN) for generating realistic underwater images from in-air image and depth pairings in an unsupervised pipeline used for color correction of monocular un…
Generative Adversarial NetworkPerceptual underwater image enhancement with deep learning and physical priors
Underwater image enhancement, as a pre-processing step to improve the accuracy of the following object detection task, has drawn considerable attention in the field of underwater navigation and ocean exploration. However…
Deep LearningImage EnhancementImage Generationobject-detection+1Advanced Underwater Image Quality Enhancement via Hybrid Super-Resolution Convolutional Neural Networks and Multi-Scale Retinex-Based Defogging Techniques
The difficulties of underwater image degradation due to light scattering, absorption, and fog-like particles which lead to low resolution and poor visibility are discussed in this study report. We suggest a sophisticated…
SSIMSuper-ResolutionBayesian Multidimensional Scaling for Location Awareness in Hybrid-Internet of Underwater Things
Localization of sensor nodes in the Internet of Underwater Things (IoUT) is of considerable significance due to its various applications, such as navigation, data tagging, and detection of underwater objects. Therefore, …
UMono: Physical Model Informed Hybrid CNN-Transformer Framework for Underwater Monocular Depth Estimation
Underwater monocular depth estimation serves as the foundation for tasks such as 3D reconstruction of underwater scenes. However, due to the influence of light and medium, the underwater environment undergoes a distincti…
3D ReconstructionDepth EstimationMonocular Depth Estimation