paper-with-me

홈 › Papers

Endo-NeRF++: Uncertainty-Aware Neural Rendering with Multi-Resolution Hash Encoding for Dynamic Surgical Scene Reconstruction

2026-07-30 · Gousia Habib, Laura Ruotsalainen arxiv

Reconstructing dynamic surgical scenes is crucial for robot-assisted minimally invasive surgery; however, it continues to be difficult because of tissue deformation, occlusions, specular reflections, and restricted viewpoints. In this study, we introduce Endo-NeRF++, a neural rendering framework that accounts for uncertainty in the reconstruction of dynamic surgical scenes. Expanding on EndoNeRF, the suggested approach incorporates multi-resolution hash-grid encoding, temporal feature merging, and uncertainty-informed adaptive sampling to enhance reconstruction accuracy and temporal coherence in deformable endoscopic scenes.The multi-resolution hash-grid representation within the framework effectively captures both coarse and fine anatomical details, while temporal feature blending ensures stable reconstruction during tissue deformation and surgical tool occlusions. Additionally, uncertainty-driven adaptive sampling assigns more samples to uncertain areas to enhance rendering quality and geometric coherence. Experiments on robotic surgical video sequences demonstrate that the proposed uncertainty-guided adaptive sampling improves PSNR by up to 1.22\,dB (4.3\%), increases SSIM by up to 5.3\%, and reduces LPIPS by up to 55.1\% compared with the EndoNeRF baseline.

📄 PDF Abstract BibTeX arXiv:2607.27825

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

UC-NeRF: Uncertainty-aware Conditional Neural Radiance Fields from Endoscopic Sparse Views

2024-09-04 · Jiaxin Guo, Jiangliu Wang, Ruofeng Wei, Di Kang 외

Visualizing surgical scenes is crucial for revealing internal anatomical structures during minimally invasive procedures. Novel View Synthesis is a vital technique that offers geometry and appearance reconstruction, enha…

NeRFNeural RenderingNovel View Synthesis

UMedNeRF: Uncertainty-aware Single View Volumetric Rendering for Medical Neural Radiance Fields

2023-11-10 · Jing Hu, Qinrui Fan, Shu Hu, Siwei Lyu 외

In the field of clinical medicine, computed tomography (CT) is an effective medical imaging modality for the diagnosis of various pathologies. Compared with X-ray images, CT images can provide more information, including…

Computed Tomography (CT)

NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusion

2023-02-20 · Jiatao Gu, Alex Trevithick, Kai-En Lin, Josh Susskind 외

Novel view synthesis from a single image requires inferring occluded regions of objects and scenes whilst simultaneously maintaining semantic and physical consistency with the input. Existing approaches condition neural …

NeRFNovel View Synthesis

Leveraging Neural Radiance Fields for Uncertainty-Aware Visual Localization

2023-10-10 · Le Chen, Weirong Chen, Rui Wang, Marc Pollefeys

As a promising fashion for visual localization, scene coordinate regression (SCR) has seen tremendous progress in the past decade. Most recent methods usually adopt neural networks to learn the mapping from image pixels …

NeRFregressionVisual Localization

Sources of Uncertainty in 3D Scene Reconstruction

2024-09-10 · Marcus Klasson, Riccardo Mereu, Juho Kannala, Arno Solin

The process of 3D scene reconstruction can be affected by numerous uncertainty sources in real-world scenes. While Neural Radiance Fields (NeRFs) and 3D Gaussian Splatting (GS) achieve high-fidelity rendering, they lack …

3D Reconstruction3D Scene ReconstructionNeRF