Transfer Learning from an Auxiliary Discriminative Task for Unsupervised Anomaly Detection
Unsupervised anomaly detection from high dimensional data like mobility networks is a challenging task. Study of different approaches of feature engineering from such high dimensional data have been a focus of research in this field. This study aims to investigate the transferability of features learned by network classification to unsupervised anomaly detection. We propose use of an auxiliary classification task to extract features from unlabelled data by supervised learning, which can be used for unsupervised anomaly detection. We validate this approach by designing experiments to detect anomalies in mobility network data from New York and Taipei, and compare the results to traditional unsupervised feature learning approaches of PCA and autoencoders. We find that our feature learning approach yields best anomaly detection performance for both datasets, outperforming other studied approaches. This establishes the utility of this approach to feature engineering, which can be applied to other problems of similar nature.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionFeature EngineeringGeneral ClassificationTransfer LearningUnsupervised Anomaly DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
FastLogAD: Log Anomaly Detection with Mask-Guided Pseudo Anomaly Generation and Discrimination
Nowadays large computers extensively output logs to record the runtime status and it has become crucial to identify any suspicious or malicious activities from the information provided by the realtime logs. Thus, fast lo…
Anomaly DetectionModel OptimizationGenerating and Reweighting Dense Contrastive Patterns for Unsupervised Anomaly Detection
Recent unsupervised anomaly detection methods often rely on feature extractors pretrained with auxiliary datasets or on well-crafted anomaly-simulated samples. However, this might limit their adaptability to an increasin…
Anomaly DetectionUnsupervised Anomaly DetectionImportance Weighted Adversarial Discriminative Transfer for Anomaly Detection
Previous transfer methods for anomaly detection generally assume the availability of labeled data in source or target domains. However, such an assumption is not valid in most real applications where large-scale labeled …
Anomaly DetectionvalidDiscriminative Feature Learning Framework with Gradient Preference for Anomaly Detection
Unsupervised representation learning has been extensively employed in anomaly detection, achieving impressive performance. Extracting valuable feature vectors that can remarkably improve the performance of anomaly detect…
Anomaly DetectionAnomaly LocalizationRepresentation LearningAnomaly Crossing: New Horizons for Video Anomaly Detection as Cross-domain Few-shot Learning
Video anomaly detection aims to identify abnormal events that occurred in videos. Since anomalous events are relatively rare, it is not feasible to collect a balanced dataset and train a binary classifier to solve the ta…
Anomaly DetectionCross-Domain Few-Shotcross-domain few-shot learningFew-Shot Learning+1