paper-with-me

Papers

LogShield: A Transformer-based APT Detection System Leveraging Self-Attention

2023-11-09 · Sihat Afnan, Mushtari Sadia, Shahrear Iqbal, Anindya Iqbal

Cyber attacks are often identified using system and network logs. There have been significant prior works that utilize provenance graphs and ML techniques to detect attacks, specifically advanced persistent threats, which are very difficult to detect. Lately, there have been studies where transformer-based language models are being used to detect various types of attacks from system logs. However, no such attempts have been made in the case of APTs. In addition, existing state-of-the-art techniques that use system provenance graphs, lack a data processing framework generalized across datasets for optimal performance. For mitigating this limitation as well as exploring the effectiveness of transformer-based language models, this paper proposes LogShield, a framework designed to detect APT attack patterns leveraging the power of self-attention in transformers. We incorporate customized embedding layers to effectively capture the context of event sequences derived from provenance graphs. While acknowledging the computational overhead associated with training transformer networks, our framework surpasses existing LSTM and Language models regarding APT detection. We integrated the model parameters and training procedure from the RoBERTa model and conducted extensive experiments on well-known APT datasets (DARPA OpTC and DARPA TC E3). Our framework achieved superior F1 scores of 98% and 95% on the two datasets respectively, surpassing the F1 scores of 96% and 94% obtained by LSTM models. Our findings suggest that LogShield's performance benefits from larger datasets and demonstrates its potential for generalization across diverse domains. These findings contribute to the advancement of APT attack detection methods and underscore the significance of transformer-based architectures in addressing security challenges in computer systems.

📄 PDF Abstract BibTeX arXiv:2311.05733

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Multi-Head Attention 설명 없음
Attention 설명 없음
Tanh Activation 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Sigmoid Activation 설명 없음
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

LogSHIELD: A Graph-based Real-time Anomaly Detection Framework using Frequency Analysis

2024-10-29 · Krishna Chandra Roy, Qian Chen

Anomaly-based cyber threat detection using deep learning is on a constant growth in popularity for novel cyber-attack detection and forensics. A robust, efficient, and real-time threat detector in a large-scale operation…

Anomaly DetectionCyber Attack DetectionGraph EmbeddingGraph Neural Network

LAM3D: Leveraging Attention for Monocular 3D Object Detection

2024-08-03 · Diana-Alexandra Sas, Leandro Di Bella, Yangxintong Lyu, Florin Oniga 외

Since the introduction of the self-attention mechanism and the adoption of the Transformer architecture for Computer Vision tasks, the Vision Transformer-based architectures gained a lot of popularity in the field, being…

3D Object DetectionAutonomous Drivingimage-classificationImage Classification+6

SelfMOTR: Revisiting MOTR with Self-Generating Detection Priors

2025-11-25 · Fabian Gülhan, Emil Mededovic, Yuli Wu, Johannes Stegmaier arxiv

End-to-end transformer architectures have driven significant progress in multi-object tracking by unifying detection and association into a single, heuristic-free framework. Despite these benefits, poor detection perform…

Multi-Object Tracking

A Self-Supervised Transformer for Unusable Shared Bike Detection

2025-05-02 · Yin Huang, Yongqi Dong, Youhua Tang, Alvaro García Hernandez

The rapid expansion of bike-sharing systems (BSS) has greatly improved urban "last-mile" connectivity, yet large-scale deployments face escalating operational challenges, particularly in detecting faulty bikes. Existing …

Binary ClassificationEnsemble Learning

Self-Supervised Graph Transformer for Deepfake Detection

2023-07-27 · Aminollah Khormali, Jiann-Shiun Yuan

Deepfake detection methods have shown promising results in recognizing forgeries within a given dataset, where training and testing take place on the in-distribution dataset. However, their performance deteriorates signi…

Contrastive LearningDeepFake DetectionFace SwappingVideo Compression