Towards a graph-based foundation model for network traffic analysis
Foundation models have shown great promise in various fields of study. A potential application of such models is in computer network traffic analysis, where these models can grasp the complexities of network traffic dynamics and adapt to any specific task or network environment with minimal fine-tuning. Previous approaches have used tokenized hex-level packet data and the model architecture of large language transformer models. We propose a new, efficient graph-based alternative at the flow-level. Our approach represents network traffic as a dynamic spatio-temporal graph, employing a self-supervised link prediction pretraining task to capture the spatial and temporal dynamics in this network graph framework. To evaluate the effectiveness of our approach, we conduct a few-shot learning experiment for three distinct downstream network tasks: intrusion detection, traffic classification, and botnet classification. Models finetuned from our pretrained base achieve an average performance increase of 6.87\% over training from scratch, demonstrating their ability to effectively learn general network traffic dynamics during pretraining. This success suggests the potential for a large-scale version to serve as an operational foundational model.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot LearningIntrusion DetectionLink PredictionTraffic ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Wavelet-Inspired Multiscale Graph Convolutional Recurrent Network for Traffic Forecasting
Traffic forecasting is the foundation for intelligent transportation systems. Spatiotemporal graph neural networks have demonstrated state-of-the-art performance in traffic forecasting. However, these methods do not expl…
DecoderGraph LearningBuilding Transportation Foundation Model via Generative Graph Transformer
Efficient traffic management is crucial for maintaining urban mobility, especially in densely populated areas where congestion, accidents, and delays can lead to frustrating and expensive commutes. However, existing pred…
Graph GenerationManagementTraffic PredictionHierarchical Graph Pooling is an Effective Citywide Traffic Condition Prediction Model
Accurate traffic conditions prediction provides a solid foundation for vehicle-environment coordination and traffic control tasks. Because of the complexity of road network data in spatial distribution and the diversity …
DiversityNode ClusteringPredictionTraffic PredictionVersatile yet Efficient Network Traffic Analysis: Offloading Network Foundation Model to SmartNIC
Pervasive encryption makes large-scale labeling infeasible for traffic analysis, while security operations demand edge analysis to avert service degradation and further vulnerabilities. These pressures have produced two …
TransWorldNG: Traffic Simulation via Foundation Model
Traffic simulation is a crucial tool for transportation decision-making and policy development. However, achieving realistic simulations in the face of the high dimensionality and heterogeneity of traffic environments is…
Decision MakingManagementmodel