paper-with-me

Papers

Mitigating Data Imbalance for Software Vulnerability Assessment: Does Data Augmentation Help?

2024-07-15 · Triet H. M. Le, M. Ali Babar

Background: Software Vulnerability (SV) assessment is increasingly adopted to address the ever-increasing volume and complexity of SVs. Data-driven approaches have been widely used to automate SV assessment tasks, particularly the prediction of the Common Vulnerability Scoring System (CVSS) metrics such as exploitability, impact, and severity. SV assessment suffers from the imbalanced distributions of the CVSS classes, but such data imbalance has been hardly understood and addressed in the literature. Aims: We conduct a large-scale study to quantify the impacts of data imbalance and mitigate the issue for SV assessment through the use of data augmentation. Method: We leverage nine data augmentation techniques to balance the class distributions of the CVSS metrics. We then compare the performance of SV assessment models with and without leveraging the augmented data. Results: Through extensive experiments on 180k+ real-world SVs, we show that mitigating data imbalance can significantly improve the predictive performance of models for all the CVSS tasks, by up to 31.8% in Matthews Correlation Coefficient. We also discover that simple text augmentation like combining random text insertion, deletion, and replacement can outperform the baseline across the board. Conclusions: Our study provides the motivation and the first promising step toward tackling data imbalance for effective SV assessment.

📄 PDF Abstract BibTeX arXiv:2407.10722

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationText Augmentation

Similar Papers 제목 키워드 기반

Dazzle: Using Optimized Generative Adversarial Networks to Address Security Data Class Imbalance Issue

2022-03-22 · Rui Shu, Tianpei Xia, Laurie Williams, Tim Menzies

Background: Machine learning techniques have been widely used and demonstrate promising performance in many software security tasks such as software vulnerability prediction. However, the class ratio within software vuln…

Bayesian Optimization

Towards an Improved Understanding of Software Vulnerability Assessment Using Data-Driven Approaches

2022-07-24 · Triet H. M. Le

The thesis advances the field of software security by providing knowledge and automation support for software vulnerability assessment using data-driven approaches. Software vulnerability assessment provides important an…

MARGIN: Margin-Aware Regularized Geometry for Imbalanced Vulnerability Detection

2026-05-11 · Yuteng Zhang, Huifang Ma, Jiahui Wei, Qingqing Li 외 arxiv

Software vulnerability detection is critical for ensuring software security and reliability. Despite recent advances in deep learning, real-world vulnerability datasets suffer from two severe challenges: frequency imbala…

Vulnerability DetectionMetric Learning

EvalSVA: Multi-Agent Evaluators for Next-Gen Software Vulnerability Assessment

2024-12-11 · Xin-Cheng Wen, Jiaxin Ye, Cuiyun Gao, Lianwei Wu 외

Software Vulnerability (SV) assessment is a crucial process of determining different aspects of SVs (e.g., attack vectors and scope) for developers to effectively prioritize efforts in vulnerability mitigation. It presen…

ChatNVD: Advancing Cybersecurity Vulnerability Assessment with Large Language Models

2024-12-06 · Shivansh Chopra, Hussain Ahmad, Diksha Goel, Claudia Szabo

The increasing frequency and sophistication of cybersecurity vulnerabilities in software systems underscores the need for more robust and effective vulnerability assessment methods. However, existing approaches often rel…