paper-with-me

Papers

Transfer Learning from an Auxiliary Discriminative Task for Unsupervised Anomaly Detection

2019-12-05 · Urwa Muaz, Stanislav Sobolevsky

Unsupervised anomaly detection from high dimensional data like mobility networks is a challenging task. Study of different approaches of feature engineering from such high dimensional data have been a focus of research in this field. This study aims to investigate the transferability of features learned by network classification to unsupervised anomaly detection. We propose use of an auxiliary classification task to extract features from unlabelled data by supervised learning, which can be used for unsupervised anomaly detection. We validate this approach by designing experiments to detect anomalies in mobility network data from New York and Taipei, and compare the results to traditional unsupervised feature learning approaches of PCA and autoencoders. We find that our feature learning approach yields best anomaly detection performance for both datasets, outperforming other studied approaches. This establishes the utility of this approach to feature engineering, which can be applied to other problems of similar nature.

📄 PDF Abstract BibTeX arXiv:1912.02864

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionFeature EngineeringGeneral ClassificationTransfer LearningUnsupervised Anomaly Detection

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

FastLogAD: Log Anomaly Detection with Mask-Guided Pseudo Anomaly Generation and Discrimination

2024-04-12 · Yifei Lin, Hanqiu Deng, Xingyu Li

Nowadays large computers extensively output logs to record the runtime status and it has become crucial to identify any suspicious or malicious activities from the information provided by the realtime logs. Thus, fast lo…

Anomaly DetectionModel Optimization

Generating and Reweighting Dense Contrastive Patterns for Unsupervised Anomaly Detection

2023-12-26 · Songmin Dai, Yifan Wu, Xiaoqiang Li, xiangyang xue

Recent unsupervised anomaly detection methods often rely on feature extractors pretrained with auxiliary datasets or on well-crafted anomaly-simulated samples. However, this might limit their adaptability to an increasin…

Anomaly DetectionUnsupervised Anomaly Detection

Importance Weighted Adversarial Discriminative Transfer for Anomaly Detection

2021-05-14 · Cangning Fan, Fangyi Zhang, Peng Liu, Xiuyu Sun 외

Previous transfer methods for anomaly detection generally assume the availability of labeled data in source or target domains. However, such an assumption is not valid in most real applications where large-scale labeled …

Anomaly Detectionvalid

Discriminative Feature Learning Framework with Gradient Preference for Anomaly Detection

2022-04-23 · Muhao Xu, Xueying Zhou, Xizhan Gao, WeiKai He 외

Unsupervised representation learning has been extensively employed in anomaly detection, achieving impressive performance. Extracting valuable feature vectors that can remarkably improve the performance of anomaly detect…

Anomaly DetectionAnomaly LocalizationRepresentation Learning

Anomaly Crossing: New Horizons for Video Anomaly Detection as Cross-domain Few-shot Learning

2021-12-12 · Guangyu Sun, Zhang Liu, Lianggong Wen, Jing Shi 외

Video anomaly detection aims to identify abnormal events that occurred in videos. Since anomalous events are relatively rare, it is not feasible to collect a balanced dataset and train a binary classifier to solve the ta…

Anomaly DetectionCross-Domain Few-Shotcross-domain few-shot learningFew-Shot Learning+1