paper-with-me

홈 › Papers

Self-Supervised and Interpretable Anomaly Detection using Network Transformers

2022-02-25 · Daniel L. Marino, Chathurika S. Wickramasinghe, Craig Rieger, Milos Manic

Monitoring traffic in computer networks is one of the core approaches for defending critical infrastructure against cyber attacks. Machine Learning (ML) and Deep Neural Networks (DNNs) have been proposed in the past as a tool to identify anomalies in computer networks. Although detecting these anomalies provides an indication of an attack, just detecting an anomaly is not enough information for a user to understand the anomaly. The black-box nature of off-the-shelf ML models prevents extracting important information that is fundamental to isolate the source of the fault/attack and take corrective measures. In this paper, we introduce the Network Transformer (NeT), a DNN model for anomaly detection that incorporates the graph structure of the communication network in order to improve interpretability. The presented approach has the following advantages: 1) enhanced interpretability by incorporating the graph structure of computer networks; 2) provides a hierarchical set of features that enables analysis at different levels of granularity; 3) self-supervised training that does not require labeled data. The presented approach was tested by evaluating the successful detection of anomalies in an Industrial Control System (ICS). The presented approach successfully identified anomalies, the devices affected, and the specific connections causing the anomalies, providing a data-driven hierarchical approach to analyze the behavior of a cyber network.

📄 PDF Abstract BibTeX arXiv:2202.12997

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly Detection

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Residual Connection 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

GeneralAD: Anomaly Detection Across Domains by Attending to Distorted Features

2024-07-17 · Luc P. J. Sträter, Mohammadreza Salehi, Efstratios Gavves, Cees G. M. Snoek 외

In the domain of anomaly detection, methods often excel in either high-level semantic or low-level industrial benchmarks, rarely achieving cross-domain proficiency. Semantic anomalies are novelties that differ in meaning…

Anomaly DetectionSelf-Driving Cars

Self-Supervised Losses for One-Class Textual Anomaly Detection

2022-04-12 · Kimberly T. Mai, Toby Davies, Lewis D. Griffin

Current deep learning methods for anomaly detection in text rely on supervisory signals in inliers that may be unobtainable or bespoke architectures that are difficult to tune. We study a simpler alternative: fine-tuning…

Anomaly Detection

Self-Attentive, Multi-Context One-Class Classification for Unsupervised Anomaly Detection on Text

2019-07-01 · ACL 2019 7 · Lukas Ruff, Yury Zemlyanskiy, V, Robert ermeulen 외

There exist few text-specific methods for unsupervised anomaly detection, and for those that do exist, none utilize pre-trained models for distributed vector representations of words. In this paper we introduce a new ano…

Anomaly DetectionContextual Anomaly DetectionGeneral ClassificationOne-Class Classification+2

Towards Self-Interpretable Graph-Level Anomaly Detection

2023-10-25 · NeurIPS 2023 11 · Yixin Liu, Kaize Ding, Qinghua Lu, Fuyi Li 외

Graph-level anomaly detection (GLAD) aims to identify graphs that exhibit notable dissimilarity compared to the majority in a collection. However, current works primarily focus on evaluating graph-level abnormality while…

Anomaly DetectionGraph Anomaly Detection

Hyperspectral Anomaly Detection with Self-Supervised Anomaly Prior

2024-04-20 · Yidan Liu, Weiying Xie, Kai Jiang, Jiaqing Zhang 외

The majority of existing hyperspectral anomaly detection (HAD) methods use the low-rank representation (LRR) model to separate the background and anomaly components, where the anomaly component is optimized by handcrafte…

Anomaly DetectionSelf-Supervised Learning