SuperPoint features in endoscopy
There is often a significant gap between research results and applicability in routine medical practice. This work studies the performance of well-known local features on a medical dataset captured during routine colonoscopy procedures. Local feature extraction and matching is a key step for many computer vision applications, specially regarding 3D modelling. In the medical domain, handcrafted local features such as SIFT, with public pipelines such as COLMAP, are still a predominant tool for this kind of tasks. We explore the potential of the well known self-supervised approach SuperPoint, present an adapted variation for the endoscopic domain and propose a challenging evaluation framework. SuperPoint based models achieve significantly higher matching quality than commonly used local features in this domain. Our adapted model avoids features within specularity regions, a frequent and problematic artifact in endoscopic images, with consequent benefits for matching and reconstruction results.
Code (1)
Similar Papers 제목 키워드 기반
SuperPoint-E: local features for 3D reconstruction via tracking adaptation in endoscopy
In this work, we focus on boosting the feature extraction to improve the performance of Structure-from-Motion (SfM) in endoscopy videos. We present SuperPoint-E, a new local feature extraction method that, using our prop…
3D ReconstructionGeometry-Aware 3D Salient Object Detection Network
Point cloud salient object detection has attracted the attention of researchers in recent years. Since existing works do not fully utilize the geometry context of 3D objects, blurry boundaries are generated when segmenti…
Objectobject-detectionObject DetectionSalient Object DetectionSuperpoint Network for Point Cloud Oversegmentation
Superpoints are formed by grouping similar points with local geometric structures, which can effectively reduce the number of primitives of point clouds for subsequent point cloud processing. Existing superpoint meth…
ClusteringSemantic SegmentationSelf-Supervised 3D Scene Flow Estimation Guided by Superpoints
3D scene flow estimation aims to estimate point-wise motions between two consecutive frames of point clouds. Superpoints, i.e., points with similar geometric features, are usually employed to capture similar motions of l…
Scene Flow EstimationSuperpoint-guided Semi-supervised Semantic Segmentation of 3D Point Clouds
3D point cloud semantic segmentation is a challenging topic in the computer vision field. Most of the existing methods in literature require a large amount of fully labeled training data, but it is extremely time-consumi…
Point Cloud SegmentationPseudo LabelSegmentationSemantic Segmentation+1