paper-with-me

Papers

Leveraging Large Language Models for Command Injection Vulnerability Analysis in Python: An Empirical Study on Popular Open-Source Projects

2025-05-21 · Yuxuan Wang, Jingshu Chen, Qingyang Wang

Command injection vulnerabilities are a significant security threat in dynamic languages like Python, particularly in widely used open-source projects where security issues can have extensive impact. With the proven effectiveness of Large Language Models(LLMs) in code-related tasks, such as testing, researchers have explored their potential for vulnerabilities analysis. This study evaluates the potential of large language models (LLMs), such as GPT-4, as an alternative approach for automated testing for vulnerability detection. In particular, LLMs have demonstrated advanced contextual understanding and adaptability, making them promising candidates for identifying nuanced security vulnerabilities within code. To evaluate this potential, we applied LLM-based analysis to six high-profile GitHub projects-Django, Flask, TensorFlow, Scikit-learn, PyTorch, and Langchain-each with over 50,000 stars and extensive adoption across software development and academic research. Our analysis assesses both the strengths and limitations of LLMs in detecting command injection vulnerabilities, evaluating factors such as detection accuracy, efficiency, and practical integration into development workflows. In addition, we provide a comparative analysis of different LLM tools to identify those most suitable for security applications. Our findings offer guidance for developers and security researchers on leveraging LLMs as innovative and automated approaches to enhance software security.

📄 PDF Abstract BibTeX arXiv:2505.15088

Code (0)

등록된 구현이 없습니다.

Tasks

Vulnerability Detection

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Position-Wise Feed-Forward Layer 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

Defending Against Indirect Prompt Injection Attacks With Spotlighting

2024-03-20 · Keegan Hines, Gary Lopez, Matthew Hall, Federico Zarfati 외

Large Language Models (LLMs), while powerful, are built and trained to process a single text input. In common applications, multiple inputs can be processed by concatenating them together into a single stream of text. Ho…

Prompt Engineering

Exfiltration of personal information from ChatGPT via prompt injection

2024-05-31 · Gregory Schwartzman

We report that ChatGPT 4 and 4o are susceptible to a prompt injection attack that allows an attacker to exfiltrate users' personal data. It is applicable without the use of any 3rd party tools and all users are currently…

Manipulating Multimodal Agents via Cross-Modal Prompt Injection

2025-04-19 · Le Wang, Zonghao Ying, Tianyuan Zhang, Siyuan Liang 외

The emergence of multimodal large language models has redefined the agent paradigm by integrating language and vision modalities with external data sources, enabling agents to better interpret human instructions and exec…

Large Language Model

Taint-Style Vulnerability Detection and Confirmation for Node.js Packages Using LLM Agent Reasoning

2026-04-22 · Ronghao Ni, Mihai Christodorescu, Limin Jia arxiv

The rapidly evolving Node$.$js ecosystem currently includes millions of packages and is a critical part of modern software supply chains, making vulnerability detection of Node$.$js packages increasingly important. Howev…

Vulnerability Detection

Machine Learning Based Network Vulnerability Analysis of Industrial Internet of Things

2019-11-13 · Maede Zolanvari, Marcio A. Teixeira, Lav Gupta, Khaled M. Khan 외

It is critical to secure the Industrial Internet of Things (IIoT) devices because of potentially devastating consequences in case of an attack. Machine learning and big data analytics are the two powerful leverages for a…

Anomaly DetectionBIG-bench Machine LearningIntrusion Detection