paper-with-me

Papers

Learning Neural Representations for Network Anomaly Detection

2019-08-01 · IEEE Transactions on Cybernetics 2019 8 · Van Loi Cao, Miguel Nicolau, and James McDermott

This paper proposes latent representation models for improving network anomaly detection. Well-known anomaly detection algorithms often suffer from challenges posed by network data, such as high dimension and sparsity, and a lack of anomaly data for training, model selection, and hyperparameter tuning. Our approach is to introduce new regularizers to a classical autoencoder (AE) and a variational AE, which force normal data into a very tight area centered at the origin in the nonsaturating area of the bottleneck unit activations. These trained AEs on normal data will push normal points toward the origin, whereas anomalies, which differ from normal data, will be put far away from the normal region. The models are very different from common regularized AEs, sparse AE, and contractive AE,in which the regularized AEs tend to make their latent representation less sensitive to changes of the input data. The bottleneck feature space is now used as a new data representation. A number of one-class learning algorithms are used for evaluating the proposed models. The experiments testify that our models help these classifiers to perform efficiently and consistently on highdimensional and sparse network datasets, even with relatively few training points. More importantly, the models can minimize the effect of model selection on these classifiers since their performance is insensitive to a wide range of hyperparameter settings.

📄 PDF Abstract BibTeX

Code (1)

vanloicao/SAEDVAE tf

Tasks

Anomaly DetectionIntrusion DetectionModel SelectionUnsupervised Anomaly Detection

Methods 이 논문이 사용한 방법론

AE An autoencoder is a type of artificial neural network used to learn efficient data codings in an unsupervised manner. The aim of an autoencoder is to learn a representation…
Solana Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

Clustering and Unsupervised Anomaly Detection with L2 Normalized Deep Auto-Encoder Representations

2018-02-01 · Caglar Aytekin, Xingyang Ni, Francesco Cricri, Emre Aksu

Clustering is essential to many tasks in pattern recognition and computer vision. With the advent of deep learning, there is an increasing interest in learning deep unsupervised representations for clustering analysis. M…

Anomaly DetectionClusteringUnsupervised Anomaly Detection

Anomaly Detection Requires Better Representations

2022-10-19 · Tal Reiss, Niv Cohen, Eliahu Horwitz, Ron Abutbul 외

Anomaly detection seeks to identify unusual phenomena, a central task in science and industry. The task is inherently unsupervised as anomalies are unexpected and unknown during training. Recent advances in self-supervis…

3D Anomaly Detection and SegmentationAnomaly DetectionPositionRepresentation Learning+1

ESAD: End-to-end Deep Semi-supervised Anomaly Detection

2020-12-09 · Chaoqin Huang, Fei Ye, Peisen Zhao, Ya zhang 외

This paper explores semi-supervised anomaly detection, a more practical setting for anomaly detection where a small additional set of labeled samples are provided. We propose a new KL-divergence based objective function …

Anomaly DetectionDecoderMedical DiagnosisSemi-supervised Anomaly Detection+1

The Deep Radial Basis Function Data Descriptor (D-RBFDD) Network: A One-Class Neural Network for Anomaly Detection

2021-01-29 · Mehran H. Z. Bazargani, Arjun Pakrashi, Brian Mac Namee

Anomaly detection is a challenging problem in machine learning, and is even more so when dealing with instances that are captured in low-level, raw data representations without a well-behaved set of engineered features. …

Anomaly Detectionimage-classificationImage ClassificationOne-class classifier+1

No Free Lunch: The Hazards of Over-Expressive Representations in Anomaly Detection

2023-06-12 · Tal Reiss, Niv Cohen, Yedid Hoshen

Anomaly detection methods, powered by deep learning, have recently been making significant progress, mostly due to improved representations. It is tempting to hypothesize that anomaly detection can improve indefinitely b…

Anomaly Detection