paper-with-me

홈 › Papers

COFT-AD: COntrastive Fine-Tuning for Few-Shot Anomaly Detection

2024-02-29 · Jingyi Liao, Xun Xu, Manh Cuong Nguyen, Adam Goodge, Chuan Sheng Foo

Existing approaches towards anomaly detection~(AD) often rely on a substantial amount of anomaly-free data to train representation and density models. However, large anomaly-free datasets may not always be available before the inference stage; in which case an anomaly detection model must be trained with only a handful of normal samples, a.k.a. few-shot anomaly detection (FSAD). In this paper, we propose a novel methodology to address the challenge of FSAD which incorporates two important techniques. Firstly, we employ a model pre-trained on a large source dataset to initialize model weights. Secondly, to ameliorate the covariate shift between source and target domains, we adopt contrastive training to fine-tune on the few-shot target domain data. To learn suitable representations for the downstream AD task, we additionally incorporate cross-instance positive pairs to encourage a tight cluster of the normal samples, and negative pairs for better separation between normal and synthesized negative samples. We evaluate few-shot anomaly detection on on 3 controlled AD tasks and 4 real-world AD tasks to demonstrate the effectiveness of the proposed method.

📄 PDF Abstract BibTeX arXiv:2402.18998

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly Detection

Similar Papers 제목 키워드 기반

Fine-tuning Pre-trained Vision-Language Models in a Human-Annotation-Free Manner

2026-02-04 · Qian-Wei Wang, Guanghao Meng, Ren Cai, Yaguang Song 외 arxiv

Large-scale vision-language models (VLMs) such as CLIP exhibit strong zero-shot generalization, but adapting them to downstream tasks typically requires costly labeled data. Existing unsupervised self-training methods re…

parameter-efficient fine-tuningZero-shot GeneralizationContrastive Learning

SCoFT: Self-Contrastive Fine-Tuning for Equitable Image Generation

2024-01-16 · CVPR 2024 1 · Zhixuan Liu, Peter Schaldenbrand, Beverley-Claire Okogwu, Wenxuan Peng 외

Accurate representation in media is known to improve the well-being of the people who consume it. Generative image models trained on large web-crawled datasets such as LAION are known to produce images with harmful stere…

Image Generation

RoCoFT: Efficient Finetuning of Large Language Models with Row-Column Updates

2024-10-14 · Md Kowsher, Tara Esmaeilbeig, Chun-Nam Yu, Mojtaba Soltanalian 외

We propose RoCoFT, a parameter-efficient fine-tuning method for large-scale language models (LMs) based on updating only a few rows and columns of the weight matrices in transformers. Through extensive experiments with m…

parameter-efficient fine-tuning

Bootstrap Fine-Grained Vision-Language Alignment for Unified Zero-Shot Anomaly Localization

2023-08-30 · Hanqiu Deng, Zhaoxiang Zhang, Jinan Bao, Xingyu Li

Contrastive Language-Image Pre-training (CLIP) models have shown promising performance on zero-shot visual recognition tasks by learning visual representations under natural language supervision. Recent studies attempt t…

Anomaly DetectionAnomaly LocalizationTest-time Adaptationzero-shot anomaly detection

Coarse-to-Fine Highlighting: Reducing Knowledge Hallucination in Large Language Models

2024-10-19 · Qitan Lv, Jie Wang, Hanzhu Chen, Bin Li 외

Generation of plausible but incorrect factual information, often termed hallucination, has attracted significant research interest. Retrieval-augmented language model (RALM) -- which enhances models with up-to-date knowl…

HallucinationLanguage ModelingLanguage ModellingQuestion Answering+1