Reconstructing the normal and shape at specularities in endoscopy
Specularities are numerous in endoscopic images. They occur as many white small elliptic spots, which are generally ruled out as nuisance in image analysis and computer vision methods. Instead, we propose to use specularities as cues for 3D perception. Specifically, we propose a new method to reconstruct, at each specularity, the observed tissue's normal direction (i.e., its orientation) and shape (i.e., its curvature) from a single image. We show results on simulated and real interventional images.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Better Together: Joint Reasoning for Non-rigid 3D Reconstruction with Specularities and Shading
We demonstrate the use of shape-from-shading (SfS) to improve both the quality and the robustness of 3D reconstruction of dynamic objects captured by a single camera. Unlike previous approaches that made use of SfS as a …
3D ReconstructionObject TrackingA Temporal Learning Approach to Inpainting Endoscopic Specularities and Its effect on Image Correspondence
Video streams are utilised to guide minimally-invasive surgery and diagnostic procedures in a wide range of procedures, and many computer assisted techniques have been developed to automatically analyse them. These appro…
3D Reconstruction3D Shape ModelingAnatomyDiagnostic+5A Hybrid Convolutional Neural Network with Meta Feature Learning for Abnormality Detection in Wireless Capsule Endoscopy Images
Wireless Capsule Endoscopy is one of the most advanced non-invasive methods for the examination of gastrointestinal tracts. An intelligent computer-aided diagnostic system for detecting gastrointestinal abnormalities lik…
Anomaly DetectionDiagnosticSelf-calibrating Photometric Stereo by Neural Inverse Rendering
This paper tackles the task of uncalibrated photometric stereo for 3D object reconstruction, where both the object shape, object reflectance, and lighting directions are unknown. This is an extremely difficult task, and …
3D Object ReconstructionInverse RenderingObjectObject ReconstructionNeural Photometric Stereo for Shape and Material Estimation
This paper addresses a challenging Photometric-Stereo problem where the object to be reconstructed has unknown, non-Lambertian, and possibly spatially-varying surface materials. This problem becomes even more challenging…