paper-with-me

Papers

Augmented Memory Replay-based Continual Learning Approaches for Network Intrusion Detection

2023-09-21 · NeurIPS 2023 11

Intrusion detection is a form of anomalous activity detection in communication network traffic. Continual learning (CL) approaches to the intrusion detection task accumulate old knowledge while adapting to the latest threat knowledge. Previous works have shown the effectiveness of memory replay-based CL approaches for this task. In this work, we present two novel contributions to improve the performance of CL-based network intrusion detection in the context of class imbalance and scalability. First, we extend class balancing reservoir sampling (CBRS), a memory-based CL method, to address the problems of severe class imbalance for large datasets. Second, we propose a novel approach titled perturbation assistance for parameter approximation (PAPA) based on the Gaussian mixture model to reduce the number of \textit{virtual stochastic gradient descent (SGD) parameter} computations needed to discover maximally interfering samples for CL. We demonstrate that the proposed approaches perform remarkably better than the baselines on standard intrusion detection benchmarks created over shorter periods (KDDCUP'99, NSL-KDD, CICIDS-2017/2018, UNSW-NB15, and CTU-13) and a longer period with distribution shift (AnoShift). We also validated proposed approaches on standard continual learning benchmarks (SVHN, CIFAR-10/100, and CLEAR-10/100) and anomaly detection benchmarks (SMAP, SMD, and MSL). Further, the proposed PAPA approach significantly lowers the number of virtual SGD update operations, thus resulting in training time savings in the range of 12 to 40\% compared to the maximally interfered samples retrieval algorithm.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SGD Stochastic Gradient Descent is an iterative optimization technique that uses minibatches of data to form an expectation of the gradient, rather than the full gradient using…

Similar Papers 제목 키워드 기반

ARROW: Augmented Replay for RObust World models

2026-03-12 · Abdulaziz Alyahya, Abdallah Al Siyabi, Markus R. Ernst, Luke Yang 외 arxiv

Continual reinforcement learning challenges agents to acquire new skills while retaining previously learned ones with the goal of improving performance in both past and future tasks. Most existing approaches rely on mode…

Reinforcement Learning

Augmenting Replay in World Models for Continual Reinforcement Learning

2024-01-30 · Luke Yang, Levin Kuhlmann, Gideon Kowadlo

Continual RL requires an agent to learn new tasks without forgetting previous ones, while improving on both past and future tasks. The most common approaches use model-free algorithms and replay buffers can help to mitig…

Continual LearningModel-based Reinforcement Learningreinforcement-learningReinforcement Learning+1

Saliency-Augmented Memory Completion for Continual Learning

2022-12-26 · Guangji Bai, Chen Ling, Yuyang Gao, Liang Zhao

Continual Learning is considered a key step toward next-generation Artificial Intelligence. Among various methods, replay-based approaches that maintain and replay a small episodic memory of previous samples are one of t…

Bilevel OptimizationContinual Learningimage-classificationImage Classification

Quantifying Catastrophic Forgetting in IoT Intrusion Detection Systems

2026-02-27 · Sourasekhar Banerjee, David Bergqvist, Salman Toor, Christian Rohner 외 arxiv

Distribution shifts in attack patterns within RPL-based IoT networks pose a critical threat to the reliability and security of large-scale connected systems. Intrusion Detection Systems (IDS) trained on static datasets o…

Intrusion DetectionContinual Learning

Practical Recommendations for Replay-based Continual Learning Methods

2022-03-19 · Gabriele Merlin, Vincenzo Lomonaco, Andrea Cossu, Antonio Carta 외

Continual Learning requires the model to learn from a stream of dynamic, non-stationary data without forgetting previous knowledge. Several approaches have been developed in the literature to tackle the Continual Learnin…

Continual LearningData Augmentation