paper-with-me

Papers

Security Concerns for Large Language Models: A Survey

2025-05-24 · Miles Q. Li, Benjamin C. M. Fung

Large Language Models (LLMs) such as GPT-4 and its recent iterations, Google's Gemini, Anthropic's Claude 3 models, and xAI's Grok have caused a revolution in natural language processing, but their capabilities also introduce new security vulnerabilities. In this survey, we provide a comprehensive overview of the emerging security concerns around LLMs, categorizing threats into prompt injection and jailbreaking, adversarial attacks such as input perturbations and data poisoning, misuse by malicious actors for purposes such as generating disinformation, phishing emails, and malware, and worrisome risks inherent in autonomous LLM agents. A significant focus has been recently placed on the latter, exploring goal misalignment, emergent deception, self-preservation instincts, and the potential for LLMs to develop and pursue covert, misaligned objectives, a behavior known as scheming, which may even persist through safety training. We summarize recent academic and industrial studies from 2022 to 2025 that exemplify each threat, analyze proposed defenses and their limitations, and identify open challenges in securing LLM-based applications. We conclude by emphasizing the importance of advancing robust, multi-layered security strategies to ensure LLMs are safe and beneficial.

📄 PDF Abstract BibTeX arXiv:2505.18889

Code (0)

등록된 구현이 없습니다.

Tasks

Data PoisoningSurvey

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Position-Wise Feed-Forward Layer 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

Blockchain for Large Language Model Security and Safety: A Holistic Survey

2024-07-26 · Caleb Geren, Amanda Board, Gaby G. Dagher, Tim Andersen 외

With the growing development and deployment of large language models (LLMs) in both industrial and academic fields, their security and safety concerns have become increasingly critical. However, recent studies indicate t…

Data PoisoningLanguage ModelingLanguage ModellingLarge Language Model

Federated Large Language Models: Feasibility, Robustness, Security and Future Directions

2025-05-13 · Wenhao Jiang, Yuchuan Luo, Guilin Deng, Silong Chen 외

The integration of Large Language Models (LLMs) and Federated Learning (FL) presents a promising solution for joint training on distributed data while preserving privacy and addressing data silo issues. However, this eme…

Federated LearningFew-Shot LearningMachine UnlearningSurvey

Training Data Extraction From Pre-trained Language Models: A Survey

2023-05-25 · Shotaro Ishihara

As the deployment of pre-trained language models (PLMs) expands, pressing security concerns have arisen regarding the potential for malicious extraction of training data, posing a threat to data privacy. This study is th…

MemorizationSurvey

JailbreakZoo: Survey, Landscapes, and Horizons in Jailbreaking Large Language and Vision-Language Models

2024-06-26 · Haibo Jin, Leyang Hu, Xinuo Li, Peiyan Zhang 외

The rapid evolution of artificial intelligence (AI) through developments in Large Language Models (LLMs) and Vision-Language Models (VLMs) has brought significant advancements across various technological domains. While …

LLM JailbreakSurvey

Security Considerations in AI-Robotics: A Survey of Current Methods, Challenges, and Opportunities

2023-10-12 · Subash Neupane, Shaswata Mitra, Ivan A. Fernandez, Swayamjit Saha 외

Robotics and Artificial Intelligence (AI) have been inextricably intertwined since their inception. Today, AI-Robotics systems have become an integral part of our daily lives, from robotic vacuum cleaners to semi-autonom…