paper-with-me

홈 › Papers

Counteracting Concept Drift by Learning with Future Malware Predictions

2024-04-14 · Branislav Bosansky, Lada Hospodkova, Michal Najman, Maria Rigaki, Elnaz Babayeva, Viliam Lisy

The accuracy of deployed malware-detection classifiers degrades over time due to changes in data distributions and increasing discrepancies between training and testing data. This phenomenon is known as the concept drift. While the concept drift can be caused by various reasons in general, new malicious files are created by malware authors with a clear intention of avoiding detection. The existence of the intention opens a possibility for predicting such future samples. Including predicted samples in training data should consequently increase the accuracy of the classifiers on new testing data. We compare two methods for predicting future samples: (1) adversarial training and (2) generative adversarial networks (GANs). The first method explicitly seeks for adversarial examples against the classifier that are then used as a part of training data. Similarly, GANs also generate synthetic training data. We use GANs to learn changes in data distributions within different time periods of training data and then apply these changes to generate samples that could be in testing data. We compare these prediction methods on two different datasets: (1) Ember public dataset and (2) the internal dataset of files incoming to Avast. We show that while adversarial training yields more robust classifiers, this method is not a good predictor of future malware in general. This is in contrast with previously reported positive results in different domains (including natural language processing and spam detection). On the other hand, we show that GANs can be successfully used as predictors of future malware. We specifically examine malware families that exhibit significant changes in their data distributions over time and the experimental results confirm that GAN-based predictions can significantly improve the accuracy of the classifier on new, previously unseen data.

📄 PDF Abstract BibTeX arXiv:2404.09352

Code (0)

등록된 구현이 없습니다.

Tasks

Malware DetectionSpam detection

Similar Papers 제목 키워드 기반

DRMD: Deep Reinforcement Learning for Malware Detection under Concept Drift

2025-08-26 · Shae McFadden, Myles Foley, Mario D'Onghia, Chris Hicks 외 arxiv

Malware detection in real-world settings must deal with evolving threats, limited labeling budgets, and uncertain predictions. Traditional classifiers, without additional mechanisms, struggle to maintain performance unde…

Reinforcement LearningMalware DetectionActive Learning

Combating Concept Drift with Explanatory Detection and Adaptation for Android Malware Classification

2024-05-07 · Yiling He, Junchi Lei, Zhan Qin, Kui Ren 외

Machine learning-based Android malware classifiers achieve high accuracy in stationary environments but struggle with concept drift. The rapid evolution of malware, especially with new families, can depress classificatio…

Drift DetectionMalware Classification

MORPH: Towards Automated Concept Drift Adaptation for Malware Detection

2024-01-23 · Md Tanvirul Alam, Romy Fieblinger, Ashim Mahara, Nidhi Rastogi

Concept drift is a significant challenge for malware detection, as the performance of trained machine learning models degrades over time, rendering them impractical. While prior research in malware concept drift adaptati…

Active LearningMalware DetectionMORPHPseudo Label

Empirical Evaluation of Concept Drift in ML-Based Android Malware Detection

2025-07-30 · Ahmed Sabbah, Radi Jarrar, Samer Zein, David Mohaisen arxiv

Despite outstanding results, machine learning-based Android malware detection models struggle with concept drift, where rapidly evolving malware characteristics degrade model effectiveness. This study examines the impact…

Few-Shot LearningMalware Detection

Cluster Analysis and Concept Drift Detection in Malware

2025-02-19 · Aniket Mishra, Mark Stamp

Concept drift refers to gradual or sudden changes in the properties of data that affect the accuracy of machine learning models. In this paper, we address the problem of concept drift detection in the malware domain. Spe…

ClusteringDrift DetectionMalware Classification