Efficient Federated Intrusion Detection in 5G ecosystem using optimized BERT-based model
The fifth-generation (5G) offers advanced services, supporting applications such as intelligent transportation, connected healthcare, and smart cities within the Internet of Things (IoT). However, these advancements introduce significant security challenges, with increasingly sophisticated cyber-attacks. This paper proposes a robust intrusion detection system (IDS) using federated learning and large language models (LLMs). The core of our IDS is based on BERT, a transformer model adapted to identify malicious network flows. We modified this transformer to optimize performance on edge devices with limited resources. Experiments were conducted in both centralized and federated learning contexts. In the centralized setup, the model achieved an inference accuracy of 97.79%. In a federated learning context, the model was trained across multiple devices using both IID (Independent and Identically Distributed) and non-IID data, based on various scenarios, ensuring data privacy and compliance with regulations. We also leveraged linear quantization to compress the model for deployment on edge devices. This reduction resulted in a slight decrease of 0.02% in accuracy for a model size reduction of 28.74%. The results underscore the viability of LLMs for deployment in IoT ecosystems, highlighting their ability to operate on devices with constrained computational and storage resources.
Code (1)
Tasks
Federated LearningIntrusion DetectionQuantizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
HBFL: A Hierarchical Blockchain-based Federated Learning Framework for a Collaborative IoT Intrusion Detection
The continuous strengthening of the security posture of IoT ecosystems is vital due to the increasing number of interconnected devices and the volume of sensitive data shared. The utilisation of Machine Learning (ML) cap…
Federated LearningIntrusion DetectionImproving Transferability of Network Intrusion Detection in a Federated Learning Setup
Network Intrusion Detection Systems (IDS) aim to detect the presence of an intruder by analyzing network packets arriving at an internet connected device. Data-driven deep learning systems, popular due to their superior …
Federated LearningIntrusion DetectionNetwork Intrusion DetectionA Lightweight Federated Learning Approach for Privacy-Preserving Botnet Detection in IoT
The rapid growth of the Internet of Things (IoT) has expanded opportunities for innovation but also increased exposure to botnet-driven cyberattacks. Conventional detection methods often struggle with scalability, privac…
Intrusion DetectionFederated LearningToward a Sustainable Federated Learning Ecosystem: A Practical Least Core Mechanism for Payoff Allocation
Emerging network paradigms and applications increasingly rely on federated learning (FL) to enable collaborative intelligence while preserving privacy. However, the sustainability of such collaborative environments hinge…
Computational EfficiencyIntrusion DetectionFederated LearningFederated Deep Learning for Intrusion Detection in IoT Networks
The vast increase of Internet of Things (IoT) technologies and the ever-evolving attack vectors have increased cyber-security risks dramatically. A common approach to implementing AI-based Intrusion Detection systems (ID…
Deep LearningFederated LearningIntrusion Detection