COFT-AD: COntrastive Fine-Tuning for Few-Shot Anomaly Detection
Existing approaches towards anomaly detection~(AD) often rely on a substantial amount of anomaly-free data to train representation and density models. However, large anomaly-free datasets may not always be available before the inference stage; in which case an anomaly detection model must be trained with only a handful of normal samples, a.k.a. few-shot anomaly detection (FSAD). In this paper, we propose a novel methodology to address the challenge of FSAD which incorporates two important techniques. Firstly, we employ a model pre-trained on a large source dataset to initialize model weights. Secondly, to ameliorate the covariate shift between source and target domains, we adopt contrastive training to fine-tune on the few-shot target domain data. To learn suitable representations for the downstream AD task, we additionally incorporate cross-instance positive pairs to encourage a tight cluster of the normal samples, and negative pairs for better separation between normal and synthesized negative samples. We evaluate few-shot anomaly detection on on 3 controlled AD tasks and 4 real-world AD tasks to demonstrate the effectiveness of the proposed method.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionSimilar Papers 제목 키워드 기반
Fine-tuning Pre-trained Vision-Language Models in a Human-Annotation-Free Manner
Large-scale vision-language models (VLMs) such as CLIP exhibit strong zero-shot generalization, but adapting them to downstream tasks typically requires costly labeled data. Existing unsupervised self-training methods re…
parameter-efficient fine-tuningZero-shot GeneralizationContrastive LearningSCoFT: Self-Contrastive Fine-Tuning for Equitable Image Generation
Accurate representation in media is known to improve the well-being of the people who consume it. Generative image models trained on large web-crawled datasets such as LAION are known to produce images with harmful stere…
Image GenerationRoCoFT: Efficient Finetuning of Large Language Models with Row-Column Updates
We propose RoCoFT, a parameter-efficient fine-tuning method for large-scale language models (LMs) based on updating only a few rows and columns of the weight matrices in transformers. Through extensive experiments with m…
parameter-efficient fine-tuningBootstrap Fine-Grained Vision-Language Alignment for Unified Zero-Shot Anomaly Localization
Contrastive Language-Image Pre-training (CLIP) models have shown promising performance on zero-shot visual recognition tasks by learning visual representations under natural language supervision. Recent studies attempt t…
Anomaly DetectionAnomaly LocalizationTest-time Adaptationzero-shot anomaly detectionCoarse-to-Fine Highlighting: Reducing Knowledge Hallucination in Large Language Models
Generation of plausible but incorrect factual information, often termed hallucination, has attracted significant research interest. Retrieval-augmented language model (RALM) -- which enhances models with up-to-date knowl…
HallucinationLanguage ModelingLanguage ModellingQuestion Answering+1