Small Effect Sizes in Malware Detection? Make Harder Train/Test Splits!
Industry practitioners care about small improvements in malware detection accuracy because their models are deployed to hundreds of millions of machines, meaning a 0.1\% change can cause an overwhelming number of false positives. However, academic research is often restrained to public datasets on the order of ten thousand samples and is too small to detect improvements that may be relevant to industry. Working within these constraints, we devise an approach to generate a benchmark of configurable difficulty from a pool of available samples. This is done by leveraging malware family information from tools like AVClass to construct training/test splits that have different generalization rates, as measured by a secondary model. Our experiments will demonstrate that using a less accurate secondary model with disparate features is effective at producing benchmarks for a more sophisticated target model that is under evaluation. We also ablate against alternative designs to show the need for our approach.
Code (0)
등록된 구현이 없습니다.
Tasks
Malware DetectionSimilar Papers 제목 키워드 기반
MDEA: Malware Detection with Evolutionary Adversarial Learning
Malware detection have used machine learning to detect malware in programs. These applications take in raw or processed binary data to neural network models to classify as benign or malicious files. Even though this appr…
BIG-bench Machine LearningMalware DetectionGrouping the executables to detect malware with high accuracy
The metamorphic malware variants with the same malicious behavior (family), can obfuscate themselves to look different from each other. This variation in structure leads to a huge signature database for traditional signa…
ClusteringVocal Bursts Intensity PredictionFlexible Android Malware Detection Model based on Generative Adversarial Networks with Code Tensor
The behavior of malware threats is gradually increasing, heightened the need for malware detection. However, existing malware detection methods only target at the existing malicious samples, the detection of fresh malici…
Android Malware DetectionMalware DetectionAn effective approach for classification of advanced malware with high accuracy
Combating malware is very important for software/systems security, but to prevent the software/systems from the advanced malware, viz. metamorphic malware is a challenging task, as it changes the structure/code after eac…
General ClassificationVocal Bursts Intensity PredictionMalware Classification using Deep Neural Networks: Performance Evaluation and Applications in Edge Devices
With the increasing extent of malware attacks in the present day along with the difficulty in detecting modern malware, it is necessary to evaluate the effectiveness and performance of Deep Neural Networks (DNNs) for mal…
Edge-computingMalware ClassificationMalware Detection