paper-with-me

Papers

Beyond NeRF Underwater: Learning Neural Reflectance Fields for True Color Correction of Marine Imagery

2023-04-06 · Tianyi Zhang, Matthew Johnson-Roberson

Underwater imagery often exhibits distorted coloration as a result of light-water interactions, which complicates the study of benthic environments in marine biology and geography. In this research, we propose an algorithm to restore the true color (albedo) in underwater imagery by jointly learning the effects of the medium and neural scene representations. Our approach models water effects as a combination of light attenuation with distance and backscattered light. The proposed neural scene representation is based on a neural reflectance field model, which learns albedos, normals, and volume densities of the underwater environment. We introduce a logistic regression model to separate water from the scene and apply distinct light physics during training. Our method avoids the need to estimate complex backscatter effects in water by employing several approximations, enhancing sampling efficiency and numerical stability during training. The proposed technique integrates underwater light effects into a volume rendering framework with end-to-end differentiability. Experimental results on both synthetic and real-world data demonstrate that our method effectively restores true color from underwater imagery, outperforming existing approaches in terms of color consistency.

📄 PDF Abstract BibTeX arXiv:2304.03384

Code (1)

tyz1030/neuralsea 공식 구현 pytorch

Tasks

NeRF

Methods 이 논문이 사용한 방법론

Logistic Regression Logistic Regression, despite its name, is a linear model for classification rather than regression. Logistic regression is also known in the literature as logit regression,…

Similar Papers 제목 키워드 기반

WaterNeRF: Neural Radiance Fields for Underwater Scenes

2022-09-27 · Advaith Venkatramanan Sethuraman, Manikandasriram Srinivasan Ramanagopal, Katherine A. Skinner

Underwater imaging is a critical task performed by marine robots for a wide range of applications including aquaculture, marine infrastructure inspection, and environmental monitoring. However, water column effects, such…

3D ReconstructionDepth Estimation

SeaSplat: Representing Underwater Scenes with 3D Gaussian Splatting and a Physically Grounded Image Formation Model

2024-09-25 · Daniel Yang, John J. Leonard, Yogesh Girdhar

We introduce SeaSplat, a method to enable real-time rendering of underwater scenes leveraging recent advances in 3D radiance fields. Underwater scenes are challenging visual environments, as rendering through a medium su…

3DGSNeRF

WaterHE-NeRF: Water-ray Tracing Neural Radiance Fields for Underwater Scene Reconstruction

2023-12-12 · Jingchun Zhou, Tianyu Liang, Dehuan Zhang, Zongxin He

Neural Radiance Field (NeRF) technology demonstrates immense potential in novel viewpoint synthesis tasks, due to its physics-based volumetric rendering process, which is particularly promising in underwater scenes. Addr…

Image RestorationNeRF

U2NeRF: Unsupervised Underwater Image Restoration and Neural Radiance Fields

2024-11-25 · Vinayak Gupta, Manoj S, Mukund Varma T, Kaushik Mitra

Underwater images suffer from colour shifts, low contrast, and haziness due to light absorption, refraction, scattering and restoring these images has warranted much attention. In this work, we present Unsupervised Under…

Image RestorationNeRFUnderwater Image Restoration

NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination

2021-06-03 · Xiuming Zhang, Pratul P. Srinivasan, Boyang Deng, Paul Debevec 외

We address the problem of recovering the shape and spatially-varying reflectance of an object from multi-view images (and their camera poses) of an object illuminated by one unknown lighting condition. This enables the r…

Depth PredictionImage RelightingInverse RenderingNeRF+3