paper-with-me

Papers

SparseIDS: Learning Packet Sampling with Reinforcement Learning

2020-02-10 · Maximilian Bachl, Fares Meghdouri, Joachim Fabini, Tanja Zseby

Recurrent Neural Networks (RNNs) have been shown to be valuable for constructing Intrusion Detection Systems (IDSs) for network data. They allow determining if a flow is malicious or not already before it is over, making it possible to take action immediately. However, considering the large number of packets that has to be inspected, for example in cloud/fog and edge computing, the question of computational efficiency arises. We show that by using a novel Reinforcement Learning (RL)-based approach called SparseIDS, we can reduce the number of consumed packets by more than three fourths while keeping classification accuracy high. To minimize the computational expenses of the RL-based sampling we show that a shared neural network can be used for both the classifier and the RL logic. Thus, no additional resources are consumed by the sampling in deployment. Comparing to various other sampling techniques, SparseIDS consistently achieves higher classification accuracy by learning to sample only relevant packets. A major novelty of our RL-based approach is that it can not only skip up to a predefined maximum number of samples like other approaches proposed in the domain of Natural Language Processing but can even skip arbitrarily many packets in one step. This enables saving even more computational resources for long sequences. Inspecting SparseIDS's behavior of choosing packets shows that it adopts different sampling strategies for different attack types and network flows. Finally we build an automatic steering mechanism that can guide SparseIDS in deployment to achieve a desired level of sparsity.

📄 PDF Abstract BibTeX arXiv:2002.03872

Code (1)

CN-TU/adversarial-recurrent-ids 공식 구현 pytorch

Tasks

Computational EfficiencyEdge-computingGeneral ClassificationIntrusion Detectionreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Buffer-aware Wireless Scheduling based on Deep Reinforcement Learning

2019-11-13 · Chen Xu, Jian Wang, Tianhang Yu, Chuili Kong 외

In this paper, the downlink packet scheduling problem for cellular networks is modeled, which jointly optimizes throughput, fairness and packet drop rate. Two genie-aided heuristic search methods are employed to explore …

Deep Reinforcement LearningFairnessHeuristic Searchreinforcement-learning+3

Using Deep Reinforcement Learning to Enhance Channel Sampling Patterns in Integrated Sensing and Communication

2024-12-04 · Federico Mason, Jacopo Pegoraro

In Integrated Sensing And Communication (ISAC) systems, estimating the micro-Doppler (mD) spectrogram of a target requires combining channel estimates retrieved from communication with ad-hoc sensing packets, which cope …

Deep Reinforcement LearningIntegrated sensing and communicationISACReinforcement Learning (RL)

Toward Packet Routing with Fully-distributed Multi-agent Deep Reinforcement Learning

2019-05-09 · Xinyu You, Xuanjie Li, Yuedong Xu, Hui Feng 외

Packet routing is one of the fundamental problems in computer networks in which a router determines the next-hop of each packet in the queue to get it as quickly as possible to its destination. Reinforcement learning (RL…

Decision MakingDeep Reinforcement LearningQ-Learningreinforcement-learning+2

MAMRL: Exploiting Multi-agent Meta Reinforcement Learning in WAN Traffic Engineering

2021-11-30 · Shan Sun, Mariam Kiran, Wei Ren

Traffic optimization challenges, such as load balancing, flow scheduling, and improving packet delivery time, are difficult online decision-making problems in wide area networks (WAN). Complex heuristics are needed for i…

Decision MakingMeta-LearningMeta Reinforcement Learningreinforcement-learning+3

Federated TD Learning over Finite-Rate Erasure Channels: Linear Speedup under Markovian Sampling

2023-05-14 · Nicolò Dal Fabbro, Aritra Mitra, George J. Pappas

Federated learning (FL) has recently gained much attention due to its effectiveness in speeding up supervised learning tasks under communication and privacy constraints. However, whether similar speedups can be establish…

Distributed OptimizationFederated LearningQuantizationreinforcement-learning+1