Progressive Retinal Image Registration via Global and Local Deformable Transformations
Retinal image registration plays an important role in the ophthalmological diagnosis process. Since there exist variances in viewing angles and anatomical structures across different retinal images, keypoint-based approaches become the mainstream methods for retinal image registration thanks to their robustness and low latency. These methods typically assume the retinal surfaces are planar, and adopt feature matching to obtain the homography matrix that represents the global transformation between images. Yet, such a planar hypothesis inevitably introduces registration errors since retinal surface is approximately curved. This limitation is more prominent when registering image pairs with significant differences in viewing angles. To address this problem, we propose a hybrid registration framework called HybridRetina, which progressively registers retinal images with global and local deformable transformations. For that, we use a keypoint detector and a deformation network called GAMorph to estimate the global transformation and local deformable transformation, respectively. Specifically, we integrate multi-level pixel relation knowledge to guide the training of GAMorph. Additionally, we utilize an edge attention module that includes the geometric priors of the images, ensuring the deformation field focuses more on the vascular regions of clinical interest. Experiments on two widely-used datasets, FIRE and FLoRI21, show that our proposed HybridRetina significantly outperforms some state-of-the-art methods. The code is available at https://github.com/lyp-deeplearning/awesome-retinal-registration.
Code (1)
Tasks
Image RegistrationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
RetinaRegNet: A Zero-Shot Approach for Retinal Image Registration
We introduce RetinaRegNet, a zero-shot image registration model designed to register retinal images with minimal overlap, large deformations, and varying image quality. RetinaRegNet addresses these challenges and achieve…
Image RegistrationRetinaMatch: Efficient Template Matching of Retina Images for Teleophthalmology
Retinal template matching and registration is an important challenge in teleophthalmology with low-cost imaging devices. However, the images from such devices generally have a small field of view (FOV) and image quality …
Dimensionality ReductionMixed RealityTemplate MatchingPCReg-Net: Progressive Contrast-Guided Registration for Cross-Domain Image Alignment
Deformable image registration across heterogeneous domains remains challenging because coupled appearance variation and geometric misalignment violate the brightness constancy assumption underlying conventional methods. …
Image RegistrationMedical Image Registration and Its Application in Retinal Images: A Review
Medical image registration is vital for disease diagnosis and treatment with its ability to merge diverse information of images, which may be captured under different times, angles, or modalities. Although several survey…
Image RegistrationMedical Image RegistrationPoint Set Registration With Global-Local Correspondence and Transformation Estimation
We present a new point set registration method with global-local correspondence and transformation estimation (GL-CATE). The geometric structures of point sets are exploited by combining the global feature, the point-to-…