paper-with-me

홈 › Papers

Self-supervised Learning for Gastrointestinal Pathologies Endoscopy Image Classification with Triplet Loss

2023-03-03 · Tai Nguyen-D-P

Recently, the amount of GI tract datasets is introduced more and more by gathering from contests and challenges. The most common task needs to solve that is to classify images from the GI tract into various classes. However, the contributions of the existing approaches exhibit lots of limitations. In this paper, we aim to develop a computer-aided diagnosis system to classify the pathological findings in endoscopy images, the system can classify some common pathologies including polyps, esophagitis, and ulcerative -- colitis. To evaluate the proposed work, we use the public dataset which is Hyper--Kvasir instead of gathering the data. The key idea of our system is to develop self-supervised learning based on the Barlow Twins framework with a downstream task which is an endoscopy image classification integrated with triplet loss and focal loss functions. The self-supervision framework and focal loss function are used to overcome class-imbalanced data, while the triplet loss function is to tackle the domain-specific properties in endoscopy images which are inter/intra-class problems. An extensive experimental study on the pathological finding images in the Hyper--Kvasir dataset has shown that our proposed system is in general better than the compared methods, whereas using a simple neural network model. This means the proposed system can be used efficiently and capable of accurately for the classification of pathology images in the GI tract.

📄 PDF Abstract BibTeX arXiv:2303.01672

Code (0)

등록된 구현이 없습니다.

Tasks

image-classificationImage ClassificationSelf-Supervised LearningTriplet

Methods 이 논문이 사용한 방법론

Focal Loss A Focal Loss function addresses class imbalance during training in tasks like object detection. Focal loss applies a modulating term to the cross entropy loss in order to…
Triplet Loss The goal of Triplet loss, in the context of Siamese Networks, is to maximize the joint probability among all score-pairs i.e. the product of all probabilities. By using its…
Barlow Twins Barlow Twins is a self-supervised learning method that applies redundancy-reduction — a principle first proposed in neuroscience — to self supervised learning. The objective…

Similar Papers 제목 키워드 기반

Domain-Adaptive Pre-training of Self-Supervised Foundation Models for Medical Image Classification in Gastrointestinal Endoscopy

2024-10-21 · Marcel Roth, Micha V. Nowak, Adrian Krenzer, Frank Puppe

Video capsule endoscopy has transformed gastrointestinal endoscopy (GIE) diagnostics by offering a non-invasive method for capturing detailed images of the gastrointestinal tract, enabling early disease detection. Howeve…

Domain Adaptationimage-classificationImage ClassificationMedical Diagnosis+2

Optimizing Gastrointestinal Diagnostics: A CNN-Based Model for VCE Image Classification

2024-11-03 · Vaneeta Ahlawat, Rohit Sharma, Urush

In recent years, the diagnosis of gastrointestinal (GI) diseases has advanced greatly with the advent of high-tech video capsule endoscopy (VCE) technology, which allows for non-invasive observation of the digestive syst…

image-classificationImage Classification

A Study on Self-Supervised Pretraining for Vision Problems in Gastrointestinal Endoscopy

2024-01-11 · Edward Sanderson, Bogdan J. Matuszewski

Solutions to vision tasks in gastrointestinal endoscopy (GIE) conventionally use image encoders pretrained in a supervised manner with ImageNet-1k as backbones. However, the use of modern self-supervised pretraining algo…

Depth EstimationLandmark RecognitionMonocular Depth Estimation

Self-supervised Monocular Depth and Pose Estimation for Endoscopy with Generative Latent Priors

2024-11-26 · Ziang Xu, Bin Li, Yang Hu, Chenyu Zhang 외

Accurate 3D mapping in endoscopy enables quantitative, holistic lesion characterization within the gastrointestinal (GI) tract, requiring reliable depth and pose estimation. However, endoscopy systems are monocular, and …

Pose Estimation

Kvasir-Instrument: Diagnostic and therapeutic tool segmentation dataset in gastrointestinal endoscopy

2020-10-23 · Debesh Jha, Sharib Ali, Krister Emanuelsen, Steven A. Hicks 외

Gastrointestinal (GI) pathologies are periodically screened, biopsied, and resected using surgical tools. Usually the procedures and the treated or resected areas are not specifically tracked or analysed during or after …

BenchmarkingDiagnosticImage AugmentationInstrument Recognition+2