paper-with-me

Papers

COROLLA: An Efficient Multi-Modality Fusion Framework with Supervised Contrastive Learning for Glaucoma Grading

2022-01-11 · Zhiyuan Cai, Li Lin, Huaqing He, Xiaoying Tang

Glaucoma is one of the ophthalmic diseases that may cause blindness, for which early detection and treatment are very important. Fundus images and optical coherence tomography (OCT) images are both widely-used modalities in diagnosing glaucoma. However, existing glaucoma grading approaches mainly utilize a single modality, ignoring the complementary information between fundus and OCT. In this paper, we propose an efficient multi-modality supervised contrastive learning framework, named COROLLA, for glaucoma grading. Through layer segmentation as well as thickness calculation and projection, retinal thickness maps are extracted from the original OCT volumes and used as a replacing modality, resulting in more efficient calculations with less memory usage. Given the high structure and distribution similarities across medical image samples, we employ supervised contrastive learning to increase our models' discriminative power with better convergence. Moreover, feature-level fusion of paired fundus image and thickness map is conducted for enhanced diagnosis accuracy. On the GAMMA dataset, our COROLLA framework achieves overwhelming glaucoma grading performance compared to state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2201.03795

Code (1)

davidczy/supcon_gamma 공식 구현 pytorch

Tasks

Contrastive Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Unsupervised Hyperspectral and Multispectral Image Fusion via Self-Supervised Modality Decoupling

2024-12-06 · Songcheng Du, Yang Zou, Zixu Wang, Xingyuan Li 외

Hyperspectral and Multispectral Image Fusion (HMIF) aims to fuse low-resolution hyperspectral images (LR-HSIs) and high-resolution multispectral images (HR-MSIs) to reconstruct high spatial and high spectral resolution i…

AllSelf-Supervised LearningSuper-Resolutionvalid

Multimodal Medical Image Classification via Synergistic Learning Pre-training

2025-09-22 · Qinghua Lin, Guang-Hai Liu, Zuoyong Li, Yang Li 외 arxiv

Multimodal pathological images are usually in clinical diagnosis, but computer vision-based multimodal image-assisted diagnosis faces challenges with modality fusion, especially in the absence of expert-annotated data. T…

Semi-supervised Medical Image ClassificationSelf-Supervised Learning

Modality-Specific Enhancement and Complementary Fusion for Semi-Supervised Multi-Modal Brain Tumor Segmentation

2025-12-10 · Tien-Dat Chung, Ba-Thinh Lam, Thanh-Huy Nguyen, Thien Nguyen 외 arxiv

Semi-supervised learning (SSL) has become a promising direction for medical image segmentation, enabling models to learn from limited labeled data alongside abundant unlabeled samples. However, existing SSL approaches fo…

Medical Image SegmentationBrain Tumor Segmentation

Unified Multi-modal Unsupervised Representation Learning for Skeleton-based Action Understanding

2023-11-06 · Shengkai Sun, Daizong Liu, Jianfeng Dong, Xiaoye Qu 외

Unsupervised pre-training has shown great success in skeleton-based action understanding recently. Existing works typically train separate modality-specific models, then integrate the multi-modal information for action u…

Action UnderstandingRepresentation LearningUnsupervised Pre-training

Diffusion based Zero-shot Medical Image-to-Image Translation for Cross Modality Segmentation

2024-04-01 · ZiHao Wang, Yingyu Yang, Yuzhou Chen, Tingting Yuan 외

Cross-modality image segmentation aims to segment the target modalities using a method designed in the source modality. Deep generative models can translate the target modality images into the source modality, thus enabl…

Image SegmentationImage-to-Image TranslationSegmentationSemantic Segmentation+2