Learning Compact and Robust Representations for Anomaly Detection
Distance-based anomaly detection methods rely on compact and separable in-distribution (ID) embeddings to effectively delineate anomaly boundaries. Single-positive contrastive formulations suffer from class collision, promoting unnecessary intra-class variance within ID samples. While multi-positive formulations can improve inlier compactness, they fail to preserve the diversity among synthetic outliers. We address these limitations by proposing a contrastive pretext task for anomaly detection that enforces three key properties: (1) compact ID clustering to reduce intra-class variance, (2) inlier-outlier separation to enhance inter-class separation, and (3) outlier-outlier separation to maintain diversity among synthetic outliers and prevent representation collapse. These properties work together to ensure a more robust and discriminative feature space for anomaly detection. Our approach achieves approximately 12x faster convergence than NT-Xent and 7x faster than Rot-SupCon, with superior performance. On CIFAR-10, it delivers an average performance boost of 6.2% over NT-Xent and 2% over Rot-SupCon, with class-specific improvements of up to 16.9%. Our code is available at https://anonymous.4open.science/r/firm-98B6.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionContrastive LearningDiversitySelf-Supervised LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Clustering and Unsupervised Anomaly Detection with L2 Normalized Deep Auto-Encoder Representations
Clustering is essential to many tasks in pattern recognition and computer vision. With the advent of deep learning, there is an increasing interest in learning deep unsupervised representations for clustering analysis. M…
Anomaly DetectionClusteringUnsupervised Anomaly DetectionGDformer: Going Beyond Subsequence Isolation for Multivariate Time Series Anomaly Detection
Unsupervised anomaly detection of multivariate time series is a challenging task, given the requirements of deriving a compact detection criterion without accessing the anomaly points. The existing methods are mainly bas…
Anomaly DetectionTime SeriesTime Series Anomaly DetectionUnsupervised Anomaly DetectionUnsupervised Video Anomaly Detection with Diffusion Models Conditioned on Compact Motion Representations
This paper aims to address the unsupervised video anomaly detection (VAD) problem, which involves classifying each frame in a video as normal or abnormal, without any access to labels. To accomplish this, the proposed me…
Anomaly DetectionVideo Anomaly DetectionAnomaly-Injected Deep Support Vector Data Description for Text Outlier Detection
Anomaly detection or outlier detection is a common task in various domains, which has attracted significant research efforts in recent years. Existing works mainly focus on structured data such as numerical or categorica…
Anomaly DetectionOutlier DetectionBounding Box Anomaly Scoring for simple and efficient Out-of-Distribution detection
Out-of-distribution (OOD) detection aims to identify inputs that differ from the training distribution in order to reduce unreliable predictions by deep neural networks. Among post-hoc feature-space approaches, OOD detec…
Out-of-Distribution Detection