paper-with-me

홈 › Papers

A Review of 3D Reconstruction Techniques for Deformable Tissues in Robotic Surgery

2024-08-08 · Mengya Xu, Ziqi Guo, An Wang, Long Bai, Hongliang Ren

As a crucial and intricate task in robotic minimally invasive surgery, reconstructing surgical scenes using stereo or monocular endoscopic video holds immense potential for clinical applications. NeRF-based techniques have recently garnered attention for the ability to reconstruct scenes implicitly. On the other hand, Gaussian splatting-based 3D-GS represents scenes explicitly using 3D Gaussians and projects them onto a 2D plane as a replacement for the complex volume rendering in NeRF. However, these methods face challenges regarding surgical scene reconstruction, such as slow inference, dynamic scenes, and surgical tool occlusion. This work explores and reviews state-of-the-art (SOTA) approaches, discussing their innovations and implementation principles. Furthermore, we replicate the models and conduct testing and evaluation on two datasets. The test results demonstrate that with advancements in these techniques, achieving real-time, high-quality reconstructions becomes feasible.

📄 PDF Abstract BibTeX arXiv:2408.04426

Code (1)

epsilon404/surgicalnerf 공식 구현 pytorch

Tasks

3D ReconstructionNeRF

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

EndoGS: Deformable Endoscopic Tissues Reconstruction with Gaussian Splatting

2024-01-21 · Lingting Zhu, Zhao Wang, Jiahao Cui, Zhenchao Jin 외

Surgical 3D reconstruction is a critical area of research in robotic surgery, with recent works adopting variants of dynamic radiance fields to achieve success in 3D reconstruction of deformable tissues from single-viewp…

3D Reconstruction

Neural Rendering for Stereo 3D Reconstruction of Deformable Tissues in Robotic Surgery

2022-06-30 · Yuehao Wang, Yonghao Long, Siu Hin Fan, Qi Dou

Reconstruction of the soft tissues in robotic surgery from endoscopic stereo videos is important for many applications such as intra-operative navigation and image-guided robotic surgery automation. Previous works on thi…

3D ReconstructionNeural Rendering

EndoGaussians: Single View Dynamic Gaussian Splatting for Deformable Endoscopic Tissues Reconstruction

2024-01-24 · Yangsen Chen, Hao Wang

The accurate 3D reconstruction of deformable soft body tissues from endoscopic videos is a pivotal challenge in medical applications such as VR surgery and medical image analysis. Existing methods often struggle with acc…

3D ReconstructionMedical Image AnalysisNeRF

Neural LerPlane Representations for Fast 4D Reconstruction of Deformable Tissues

2023-05-31 · Chen Yang, Kailing Wang, Yuehao Wang, Xiaokang Yang 외

Reconstructing deformable tissues from endoscopic stereo videos in robotic surgery is crucial for various clinical applications. However, existing methods relying only on implicit representations are computationally expe…

4D reconstruction

NeRFscopy: Neural Radiance Fields for in-vivo Time-Varying Tissues from Endoscopy

2026-02-17 · Laura Salort-Benejam, Antonio Agudo arxiv

Endoscopy is essential in medical imaging, used for diagnosis, prognosis and treatment. Developing a robust dynamic 3D reconstruction pipeline for endoscopic videos could enhance visualization, improve diagnostic accurac…

Novel View Synthesis3D Reconstruction