paper-with-me

Papers

Dual-Image Enhanced CLIP for Zero-Shot Anomaly Detection

2024-05-08 · Zhaoxiang Zhang, Hanqiu Deng, Jinan Bao, Xingyu Li

Image Anomaly Detection has been a challenging task in Computer Vision field. The advent of Vision-Language models, particularly the rise of CLIP-based frameworks, has opened new avenues for zero-shot anomaly detection. Recent studies have explored the use of CLIP by aligning images with normal and prompt descriptions. However, the exclusive dependence on textual guidance often falls short, highlighting the critical importance of additional visual references. In this work, we introduce a Dual-Image Enhanced CLIP approach, leveraging a joint vision-language scoring system. Our methods process pairs of images, utilizing each as a visual reference for the other, thereby enriching the inference process with visual context. This dual-image strategy markedly enhanced both anomaly classification and localization performances. Furthermore, we have strengthened our model with a test-time adaptation module that incorporates synthesized anomalies to refine localization capabilities. Our approach significantly exploits the potential of vision-language joint anomaly detection and demonstrates comparable performance with current SOTA methods across various datasets.

📄 PDF Abstract BibTeX arXiv:2405.04782

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly ClassificationAnomaly DetectionTest-time Adaptationzero-shot anomaly detection

Methods 이 논문이 사용한 방법론

CLIP Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning…

Similar Papers 제목 키워드 기반

FALIP: Visual Prompt as Foveal Attention Boosts CLIP Zero-Shot Performance

2024-07-08 · Jiedong Zhuang, Jiaqi Hu, Lianrui Mu, Rui Hu 외

CLIP has achieved impressive zero-shot performance after pre-training on a large-scale dataset consisting of paired image-text data. Previous works have utilized CLIP by incorporating manually designed visual prompts lik…

image-classificationImage Classification

FLEX-CLIP: Feature-Level GEneration Network Enhanced CLIP for X-shot Cross-modal Retrieval

2024-11-26 · Jingyou Xie, Jiayi Kuang, Zhenzhou Lin, Jiarui Ouyang 외

Given a query from one modality, few-shot cross-modal retrieval (CMR) retrieves semantically similar instances in another modality with the target domain including classes that are disjoint from the source domain. Compar…

Cross-Modal RetrievalRetrievalZero-Shot Learning

AdaCLIP: Adapting CLIP with Hybrid Learnable Prompts for Zero-Shot Anomaly Detection

2024-07-22 · Yunkang Cao, Jiangning Zhang, Luca Frittoli, Yuqi Cheng 외

Zero-shot anomaly detection (ZSAD) targets the identification of anomalies within images from arbitrary novel categories. This study introduces AdaCLIP for the ZSAD task, leveraging a pre-trained vision-language model (V…

Anomaly DetectionLanguage ModelingLanguage Modellingzero-shot anomaly detection

PowerCLIP: Powerset Alignment for Contrastive Pre-Training

2025-11-28 · Masaki Kawamura, Nakamasa Inoue, Rintaro Yanagi, Hirokatsu Kataoka 외 arxiv

Contrastive vision-language pre-training frameworks such as CLIP have demonstrated impressive zero-shot performance across a range of vision-language tasks. Recent studies have shown that aligning individual text tokens …

KPL: Training-Free Medical Knowledge Mining of Vision-Language Models

2025-01-20 · Jiaxiang Liu, Tianxiang Hu, Jiawei Du, Ruiyuan Zhang 외

Visual Language Models such as CLIP excel in image recognition due to extensive image-text pre-training. However, applying the CLIP inference in zero-shot classification, particularly for medical image diagnosis, faces c…

Classificationimage-classificationImage ClassificationMedical Image Classification+3