A Review of 3D Reconstruction Techniques for Deformable Tissues in Robotic Surgery
As a crucial and intricate task in robotic minimally invasive surgery, reconstructing surgical scenes using stereo or monocular endoscopic video holds immense potential for clinical applications. NeRF-based techniques have recently garnered attention for the ability to reconstruct scenes implicitly. On the other hand, Gaussian splatting-based 3D-GS represents scenes explicitly using 3D Gaussians and projects them onto a 2D plane as a replacement for the complex volume rendering in NeRF. However, these methods face challenges regarding surgical scene reconstruction, such as slow inference, dynamic scenes, and surgical tool occlusion. This work explores and reviews state-of-the-art (SOTA) approaches, discussing their innovations and implementation principles. Furthermore, we replicate the models and conduct testing and evaluation on two datasets. The test results demonstrate that with advancements in these techniques, achieving real-time, high-quality reconstructions becomes feasible.
Code (1)
Tasks
3D ReconstructionNeRFMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
EndoGS: Deformable Endoscopic Tissues Reconstruction with Gaussian Splatting
Surgical 3D reconstruction is a critical area of research in robotic surgery, with recent works adopting variants of dynamic radiance fields to achieve success in 3D reconstruction of deformable tissues from single-viewp…
3D ReconstructionNeural Rendering for Stereo 3D Reconstruction of Deformable Tissues in Robotic Surgery
Reconstruction of the soft tissues in robotic surgery from endoscopic stereo videos is important for many applications such as intra-operative navigation and image-guided robotic surgery automation. Previous works on thi…
3D ReconstructionNeural RenderingEndoGaussians: Single View Dynamic Gaussian Splatting for Deformable Endoscopic Tissues Reconstruction
The accurate 3D reconstruction of deformable soft body tissues from endoscopic videos is a pivotal challenge in medical applications such as VR surgery and medical image analysis. Existing methods often struggle with acc…
3D ReconstructionMedical Image AnalysisNeRFNeural LerPlane Representations for Fast 4D Reconstruction of Deformable Tissues
Reconstructing deformable tissues from endoscopic stereo videos in robotic surgery is crucial for various clinical applications. However, existing methods relying only on implicit representations are computationally expe…
4D reconstructionNeRFscopy: Neural Radiance Fields for in-vivo Time-Varying Tissues from Endoscopy
Endoscopy is essential in medical imaging, used for diagnosis, prognosis and treatment. Developing a robust dynamic 3D reconstruction pipeline for endoscopic videos could enhance visualization, improve diagnostic accurac…
Novel View Synthesis3D Reconstruction