Colo-SCRL: Self-Supervised Contrastive Representation Learning for Colonoscopic Video Retrieval
Colonoscopic video retrieval, which is a critical part of polyp treatment, has great clinical significance for the prevention and treatment of colorectal cancer. However, retrieval models trained on action recognition datasets usually produce unsatisfactory retrieval results on colonoscopic datasets due to the large domain gap between them. To seek a solution to this problem, we construct a large-scale colonoscopic dataset named Colo-Pair for medical practice. Based on this dataset, a simple yet effective training method called Colo-SCRL is proposed for more robust representation learning. It aims to refine general knowledge from colonoscopies through masked autoencoder-based reconstruction and momentum contrast to improve retrieval performance. To the best of our knowledge, this is the first attempt to employ the contrastive learning paradigm for medical video retrieval. Empirical results show that our method significantly outperforms current state-of-the-art methods in the colonoscopic video retrieval task.
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionContrastive LearningGeneral KnowledgeRepresentation LearningRetrievalVideo RetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Spatially Consistent Representation Learning
Self-supervised learning has been widely used to obtain transferrable representations from unlabeled images. Especially, recent contrastive learning methods have shown impressive performances on downstream image classifi…
Contrastive Learningimage-classificationImage ClassificationInstance Segmentation+5Self-supervised Consensus Representation Learning for Attributed Graph
Attempting to fully exploit the rich information of topological structure and node features for attributed graph, we introduce self-supervised learning mechanism to graph representation learning and propose a novel Self-…
Graph Representation LearningNode ClassificationRepresentation LearningSelf-Supervised LearningA Mutual Information Perspective on Multiple Latent Variable Generative Models for Positive View Generation
In image generation, Multiple Latent Variable Generative Models (MLVGMs) employ multiple latent variables to gradually shape the final images, from global characteristics to finer and local details (e.g., StyleGAN, NVAE)…
Image GenerationRepresentation LearningSelf-Supervised LearningContrastive Learning under Noisy Temporal Self-Supervision for Colonoscopy Videos
Learning robust representations of polyp tracklets is key to enabling multiple AI-assisted colonoscopy applications, from polyp characterization to automated reporting and retrieval. Supervised contrastive learning is an…
Contrastive LearningDirect Coloring for Self-Supervised Enhanced Feature Decoupling
The success of self-supervised learning (SSL) has been the focus of multiple recent theoretical and empirical studies, including the role of data augmentation (in feature decoupling) as well as complete and dimensional r…
Data AugmentationRepresentation LearningSelf-Supervised Learning