MADPOT: Medical Anomaly Detection with CLIP Adaptation and Partial Optimal Transport
Medical anomaly detection (AD) is challenging due to diverse imaging modalities, anatomical variations, and limited labeled data. We propose a novel approach combining visual adapters and prompt learning with Partial Optimal Transport (POT) and contrastive learning (CL) to improve CLIP's adaptability to medical images, particularly for AD. Unlike standard prompt learning, which often yields a single representation, our method employs multiple prompts aligned with local features via POT to capture subtle abnormalities. CL further enforces intra-class cohesion and inter-class separation. Our method achieves state-of-the-art results in few-shot, zero-shot, and cross-dataset scenarios without synthetic data or memory banks. The code is available at https://github.com/mahshid1998/MADPOT.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningAnomaly DetectionSimilar Papers 제목 키워드 기반
Exploring Zero-Shot Anomaly Detection with CLIP in Medical Imaging: Are We There Yet?
Zero-shot anomaly detection (ZSAD) offers potential for identifying anomalies in medical imaging without task-specific training. In this paper, we evaluate CLIP-based models, originally developed for industrial tasks, on…
Anomaly DetectionGeneral Knowledgezero-shot anomaly detectionMedSAD-CLIP: Supervised CLIP with Token-Patch Cross-Attention for Medical Anomaly Detection and Segmentation
Medical anomaly detection (MAD) and segmentation play a critical role in assisting clinical diagnosis by identifying abnormal regions in medical images and localizing pathological regions. Recent CLIP-based studies are p…
Anomaly DetectionMediCLIP: Adapting CLIP for Few-shot Medical Image Anomaly Detection
In the field of medical decision-making, precise anomaly detection in medical imaging plays a pivotal role in aiding clinicians. However, previous work is reliant on large-scale datasets for training anomaly detection mo…
Anomaly DetectionDecision MakingLanguage ModellingAdapting Visual-Language Models for Generalizable Anomaly Detection in Medical Images
Recent advancements in large-scale visual-language pre-trained models have led to significant progress in zero-/few-shot anomaly detection within natural image domains. However, the substantial domain divergence between …
Anomaly ClassificationAnomaly DetectionAnomaly SegmentationAdaCLIP: Adapting CLIP with Hybrid Learnable Prompts for Zero-Shot Anomaly Detection
Zero-shot anomaly detection (ZSAD) targets the identification of anomalies within images from arbitrary novel categories. This study introduces AdaCLIP for the ZSAD task, leveraging a pre-trained vision-language model (V…
Anomaly DetectionLanguage ModelingLanguage Modellingzero-shot anomaly detection