A Keypoint Detection and Description Network Based on the Vessel Structure for Multi-Modal Retinal Image Registration
Ophthalmological imaging utilizes different imaging systems, such as color fundus, infrared, fluorescein angiography, optical coherence tomography (OCT) or OCT angiography. Multiple images with different modalities or acquisition times are often analyzed for the diagnosis of retinal diseases. Automatically aligning the vessel structures in the images by means of multi-modal registration can support the ophthalmologists in their work. Our method uses a convolutional neural network to extract features of the vessel structure in multi-modal retinal images. We jointly train a keypoint detection and description network on small patches using a classification and a cross-modal descriptor loss function and apply the network to the full image size in the test phase. Our method demonstrates the best registration performance on our and a public multi-modal dataset in comparison to competing methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Image RegistrationKeypoint DetectionSimilar Papers 제목 키워드 기반
Multi-modal Retinal Image Registration Using a Keypoint-Based Vessel Structure Aligning Network
In ophthalmological imaging, multiple imaging systems, such as color fundus, infrared, fluorescein angiography, optical coherence tomography (OCT) or OCT angiography, are often involved to make a diagnosis of retinal dis…
Graph Neural NetworkImage RegistrationKeypoint DetectionNeural Outlier Rejection for Self-Supervised Keypoint Learning
Identifying salient points in images is a crucial component for visual odometry, Structure-from-Motion or SLAM algorithms. Recently, several learned keypoint methods have demonstrated compelling performance on challengin…
Homography EstimationInterest Point DetectionKeypoint DetectionVisual OdometryTopology Repairing of Disconnected Pulmonary Airways and Vessels: Baselines and a Dataset
Accurate segmentation of pulmonary airways and vessels is crucial for the diagnosis and treatment of pulmonary diseases. However, current deep learning approaches suffer from disconnectivity issues that hinder their clin…
Keypoint DetectionR2D2: Reliable and Repeatable Detector and Descriptor
Interest point detection and local feature description are fundamental steps in many computer vision applications. Classical approaches are based on a detect-then-describe paradigm where separate handcrafted methods are …
Atari GamesCamera LocalizationImage MatchingInterest Point Detection+2R2D2: Repeatable and Reliable Detector and Descriptor
Interest point detection and local feature description are fundamental steps in many computer vision applications. Classical methods for these tasks are based on a detect-then-describe paradigm where separate handcrafted…
Interest Point DetectionKeypoint DetectionMetric Learning