paper-with-me

Papers

DenseUNets with feedback non-local attention for the segmentation of specular microscopy images of the corneal endothelium with guttae

2022-03-03 · Juan P. Vigueras-Guillén, Jeroen van Rooij, Bart T. H. van Dooren, Hans G. Lemij, Esma Islamaj, Lucas J. van Vliet, Koenraad A. Vermeer

To estimate the corneal endothelial parameters from specular microscopy images depicting cornea guttata (Fuchs dystrophy), we propose a new deep learning methodology that includes a novel attention mechanism named feedback non-local attention (fNLA). Our approach first infers the cell edges, then selects the cells that are well detected, and finally applies a postprocessing method to correct mistakes and provide the binary segmentation from which the corneal parameters are estimated (cell density [ECD], coefficient of variation [CV], and hexagonality [HEX]). In this study, we analyzed 1203 images acquired with a Topcon SP-1P microscope, 500 of which contained guttae. Manual segmentation was performed in all images. We compared the results of different networks (UNet, ResUNeXt, DenseUNets, UNet++) and found that DenseUNets with fNLA provided the best performance, with a mean absolute error of 23.16 [cells/mm$^{2}$] in ECD, 1.28 [%] in CV, and 3.13 [%] in HEX, which was 3-6 times smaller than the error obtained by Topcon's built-in software. Our approach handled the cells affected by guttae remarkably well, detecting cell edges occluded by small guttae while discarding areas covered by large guttae. Overall, the proposed method obtained accurate estimations in extremely challenging specular images.

📄 PDF Abstract BibTeX arXiv:2203.01882

Code (2)

jpviguerasguillen/feedback-non-local-attention-fnla 공식 구현 tf
jpviguerasguillen/feedback-non-local-attention_fNLA 공식 구현 tf

Similar Papers 제목 키워드 기반

Joint network for specular highlight detection and adversarial generation of specular-free images trained with polarimetric data

2023-11-28 · Neurocomputing 2023 11 · Atif Anwer, Samia Ainouz, Naufal M. Saad, Syed Saad Azhar Ali 외

Specular highlights in images pose a significant challenge in algorithms for image segmentation, object detection and other image-based decision-making systems. However, most systems ignore this particular scenario and n…

Decision MakingGenerative Adversarial NetworkHighlight Detectionhighlight removal+5

Shift-Window Meets Dual Attention: A Multi-Model Architecture for Specular Highlight Removal

2025-12-04 · Tianci Huo, Lingfeng Qi, Yuhan Chen, Qihong Xue 외 arxiv

Inevitable specular highlights in practical environments severely impair the visual performance, thus degrading the task effectiveness and efficiency. Although there exist considerable methods that focus on local informa…

Single-Image Specular Highlight Removal via Real-World Dataset Construction

2021-08-27 · TMM 2021 8 · Zhongqi Wu, Chuanqing Zhuang, Jian Shi, Jianwei Guo 외

Specular reflections pose great challenges on various multimedia and computer vision tasks, e.g. , image segmentation, detection and matching. In this paper, we build a large-scale Paired Specular-Diffuse (PSD) image dat…

Generative Adversarial NetworkHighlight Detectionhighlight removalImage Segmentation+1

RAUNet: Residual Attention U-Net for Semantic Segmentation of Cataract Surgical Instruments

2019-09-23 · Zhen-Liang Ni, Gui-Bin Bian, Xiao-Hu Zhou, Zeng-Guang Hou 외

Semantic segmentation of surgical instruments plays a crucial role in robot-assisted surgery. However, accurate segmentation of cataract surgical instruments is still a challenge due to specular reflection and class imba…

SegmentationSemantic Segmentation

Dual-Hybrid Attention Network for Specular Highlight Removal

2024-07-17 · Xiaojiao Guo, Xuhang Chen, Shenghong Luo, Shuqiang Wang 외

Specular highlight removal plays a pivotal role in multimedia applications, as it enhances the quality and interpretability of images and videos, ultimately improving the performance of downstream tasks such as content-b…

highlight removalObject RecognitionScene UnderstandingSpecular Reflection Mitigation