Reference-based OCT Angiogram Super-resolution with Learnable Texture Generation
Optical coherence tomography angiography (OCTA) is a new imaging modality to visualize retinal microvasculature and has been readily adopted in clinics. High-resolution OCT angiograms are important to qualitatively and quantitatively identify potential biomarkers for different retinal diseases accurately. However, one significant problem of OCTA is the inevitable decrease in resolution when increasing the field-of-view given a fixed acquisition time. To address this issue, we propose a novel reference-based super-resolution (RefSR) framework to preserve the resolution of the OCT angiograms while increasing the scanning area. Specifically, textures from the normal RefSR pipeline are used to train a learnable texture generator (LTG), which is designed to generate textures according to the input. The key difference between the proposed method and traditional RefSR models is that the textures used during inference are generated by the LTG instead of being searched from a single reference image. Since the LTG is optimized throughout the whole training process, the available texture space is significantly enlarged and no longer limited to a single reference image, but extends to all textures contained in the training samples. Moreover, our proposed LTGNet does not require a reference image at the inference phase, thereby becoming invulnerable to the selection of the reference image. Both experimental and visual results show that LTGNet has superior performance and robustness over state-of-the-art methods, indicating good reliability and promise in real-life deployment. The source code will be made available upon acceptance.
Code (0)
등록된 구현이 없습니다.
Tasks
Reference-based Super-ResolutionSuper-ResolutionTexture SynthesisSimilar Papers 제목 키워드 기반
Reconstruction of high-resolution 6x6-mm OCT angiograms using deep learning
Typical optical coherence tomographic angiography (OCTA) acquisition areas on commercial devices are 3x3- or 6x6-mm. Compared to 3x3-mm angiograms with proper sampling density, 6x6-mm angiograms have significantly lower …
Deep LearningImage EnhancementVocal Bursts Intensity PredictionLearning Texture Transformer Network for Image Super-Resolution
We study on image super-resolution (SR), which aims to recover realistic textures from a low-resolution (LR) image. Recent progress has been made by taking high-resolution images as references (Ref), so that relevant tex…
Hard AttentionImage GenerationImage Super-ResolutionSuper-Resolution+1Reference-Conditioned Super-Resolution by Neural Texture Transfer
With the recent advancement in deep learning, we have witnessed a great progress in single image super-resolution. However, due to the significant information loss of the image downscaling process, it has become extremel…
Image StylizationImage Super-ResolutionReference-based Super-ResolutionSuper-ResolutionUnaligned RGB Guided Hyperspectral Image Super-Resolution with Spatial-Spectral Concordance
Hyperspectral images super-resolution aims to improve the spatial resolution, yet its performance is often limited at high-resolution ratios. The recent adoption of high-resolution reference images for super-resolution i…
Hyperspectral Image Super-ResolutionImage Super-ResolutionOptical Flow EstimationSuper-ResolutionFeature Representation Matters: End-to-End Learning for Reference-based Image Super-resolution
In this paper, we are aiming for a general reference-based super-resolution setting: it does not require the low-resolution image and the high-resolution reference image to be well aligned or with a similar texture. Inst…
Image GenerationImage Super-ResolutionReference-based Super-ResolutionSuper-Resolution