paper-with-me

홈 › Papers

A Multimodal Approach For Endoscopic VCE Image Classification Using BiomedCLIP-PubMedBERT

2024-10-25 · Nagarajan Ganapathy, Podakanti Satyajith Chary, Teja Venkata Ramana Kumar Pithani, Pavan Kavati, Arun Kumar S

This Paper presents an advanced approach for fine-tuning BiomedCLIP PubMedBERT, a multimodal model, to classify abnormalities in Video Capsule Endoscopy (VCE) frames, aiming to enhance diagnostic efficiency in gastrointestinal healthcare. By integrating the PubMedBERT language model with a Vision Transformer (ViT) to process endoscopic images, our method categorizes images into ten specific classes: angioectasia, bleeding, erosion, erythema, foreign body, lymphangiectasia, polyp, ulcer, worms, and normal. Our workflow incorporates image preprocessing and fine-tunes the BiomedCLIP model to generate high-quality embeddings for both visual and textual inputs, aligning them through similarity scoring for classification. Performance metrics, including classification, accuracy, recall, and F1 score, indicate the models strong ability to accurately identify abnormalities in endoscopic frames, showing promise for practical use in clinical diagnostics.

📄 PDF Abstract BibTeX arXiv:2410.19944

Code (1)

Satyajithchary/MedInfoLab_Capsule_Vision_2024_Challenge 공식 구현

Tasks

Diagnosticimage-classificationImage ClassificationLanguage ModelingLanguage Modelling

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Multi-Head Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Adam 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs

2023-03-02 · Sheng Zhang, Yanbo Xu, Naoto Usuyama, Hanwen Xu 외

Biomedical data is inherently multimodal, comprising physical measurements and natural language narratives. A generalist biomedical AI model needs to simultaneously process different modalities of data, including text an…

ArticlesMedical Visual Question AnsweringPneumonia DetectionQuestion Answering+3

Comparison of ConvNeXt and Vision-Language Models for Breast Density Assessment in Screening Mammography

2025-06-16 · Yusdivia Molina-Román, David Gómez-Ortiz, Ernestina Menasalvas-Ruiz, José Gerardo Tamez-Peña 외

Mammographic breast density classification is essential for cancer risk assessment but remains challenging due to subjective interpretation and inter-observer variability. This study compares multimodal and CNN-based met…

breast density classificationClassificationzero-shot-classificationZero-Shot Learning

TextSAM-EUS: Text Prompt Learning for SAM to Accurately Segment Pancreatic Tumor in Endoscopic Ultrasound

2025-07-24 · Pascal Spiegler, Taha Koleilat, Arash Harirpoush, Corey S. Miller 외 arxiv

Pancreatic cancer carries a poor prognosis and relies on endoscopic ultrasound (EUS) for targeted biopsy and radiotherapy. However, the speckle noise, low contrast, and unintuitive appearance of EUS make segmentation of …

Medical Image SegmentationTumor Segmentation

Interpreting Biomedical VLMs on High-Imbalance Out-of-Distributions: An Insight into BiomedCLIP on Radiology

2025-06-17 · Nafiz Sadman, Farhana Zulkernine, Benjamin Kwan

In this paper, we construct two research objectives: i) explore the learned embedding space of BiomedCLIP, an open-source large vision language model, to analyse meaningful class separations, and ii) quantify the limitat…

Language ModelingLanguage Modelling

A comprehensive multimodal dataset and benchmark for ulcerative colitis scoring in endoscopy

2026-03-15 · Noha Ghatwary, Jiangbei Yue, Ahmed Elgendy, Hanna Nagdy 외 arxiv

Ulcerative colitis (UC) is a chronic mucosal inflammatory condition that places patients at increased risk of colorectal cancer. Colonoscopic surveillance remains the gold standard for assessing disease activity, and rep…

Image Captioning