paper-with-me

Papers

XGV-BERT: Leveraging Contextualized Language Model and Graph Neural Network for Efficient Software Vulnerability Detection

2023-09-26 · Vu Le Anh Quan, Chau Thuan Phat, Kiet Van Nguyen, Phan The Duy, Van-Hau Pham

With the advancement of deep learning (DL) in various fields, there are many attempts to reveal software vulnerabilities by data-driven approach. Nonetheless, such existing works lack the effective representation that can retain the non-sequential semantic characteristics and contextual relationship of source code attributes. Hence, in this work, we propose XGV-BERT, a framework that combines the pre-trained CodeBERT model and Graph Neural Network (GCN) to detect software vulnerabilities. By jointly training the CodeBERT and GCN modules within XGV-BERT, the proposed model leverages the advantages of large-scale pre-training, harnessing vast raw data, and transfer learning by learning representations for training data through graph convolution. The research results demonstrate that the XGV-BERT method significantly improves vulnerability detection accuracy compared to two existing methods such as VulDeePecker and SySeVR. For the VulDeePecker dataset, XGV-BERT achieves an impressive F1-score of 97.5%, significantly outperforming VulDeePecker, which achieved an F1-score of 78.3%. Again, with the SySeVR dataset, XGV-BERT achieves an F1-score of 95.5%, surpassing the results of SySeVR with an F1-score of 83.5%.

📄 PDF Abstract BibTeX arXiv:2309.14677

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Neural NetworkLanguage ModelingLanguage ModellingTransfer LearningVulnerability Detection

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음
CodeBERT 설명 없음
GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…

Similar Papers 제목 키워드 기반

Leveraging Generative AI: Improving Software Metadata Classification with Generated Code-Comment Pairs

2023-10-14 · Samah Syed, Angel Deborah S

In software development, code comments play a crucial role in enhancing code comprehension and collaboration. This research paper addresses the challenge of objectively classifying code comments as "Useful" or "Not Usefu…

Language ModellingLarge Language Model

BERT-MK: Integrating Graph Contextualized Knowledge into Pre-trained Language Models

2020-11-01 · Findings of the Association for Computational Linguistics 2020 · Bin He, Di Zhou, Jinghui Xiao, Xin Jiang 외

Complex node interactions are common in knowledge graphs (KGs), and these interactions can be considered as contextualized knowledge exists in the topological structure of KGs. Traditional knowledge representation learni…

Knowledge GraphsLanguage ModelingLanguage ModellingRepresentation Learning

ViCGCN: Graph Convolutional Network with Contextualized Language Models for Social Media Mining in Vietnamese

2023-09-06 · Chau-Thang Phan, Quoc-Nam Nguyen, Chi-Thanh Dang, Trong-Hop Do 외

Social media processing is a fundamental task in natural language processing with numerous applications. As Vietnamese social media and information science have grown rapidly, the necessity of information-based mining on…

Language Modellingtext-classificationText ClassificationVietnamese Social Media Text Processing

Table Search Using a Deep Contextualized Language Model

2020-05-19 · Zhiyu Chen, Mohamed Trabelsi, Jeff Heflin, Yinan Xu 외

Pretrained contextualized language models such as BERT have achieved impressive results on various natural language processing benchmarks. Benefiting from multiple pretraining tasks and large scale training corpora, pret…

Language ModelingLanguage ModellingRetrievalTable Retrieval+1

CoLAKE: Contextualized Language and Knowledge Embedding

2020-10-01 · COLING 2020 8 · Tianxiang Sun, Yunfan Shao, Xipeng Qiu, Qipeng Guo 외

With the emerging branch of incorporating factual knowledge into pre-trained language models such as BERT, most existing models consider shallow, static, and separately pre-trained entity embeddings, which limits the per…

Entity EmbeddingsKnowledge Graph CompletionKnowledge Probing