paper-with-me

Papers

Safeguarding Large Language Models: A Survey

2024-06-03 · Yi Dong, Ronghui Mu, Yanghao Zhang, Siqi Sun, Tianle Zhang, Changshun Wu, Gaojie Jin, Yi Qi, Jinwei Hu, Jie Meng, Saddek Bensalem, Xiaowei Huang

In the burgeoning field of Large Language Models (LLMs), developing a robust safety mechanism, colloquially known as "safeguards" or "guardrails", has become imperative to ensure the ethical use of LLMs within prescribed boundaries. This article provides a systematic literature review on the current status of this critical mechanism. It discusses its major challenges and how it can be enhanced into a comprehensive mechanism dealing with ethical issues in various contexts. First, the paper elucidates the current landscape of safeguarding mechanisms that major LLM service providers and the open-source community employ. This is followed by the techniques to evaluate, analyze, and enhance some (un)desirable properties that a guardrail might want to enforce, such as hallucinations, fairness, privacy, and so on. Based on them, we review techniques to circumvent these controls (i.e., attacks), to defend the attacks, and to reinforce the guardrails. While the techniques mentioned above represent the current status and the active research trends, we also discuss several challenges that cannot be easily dealt with by the methods and present our vision on how to implement a comprehensive guardrail through the full consideration of multi-disciplinary approach, neural-symbolic method, and systems development lifecycle.

📄 PDF Abstract BibTeX arXiv:2406.02622

Code (0)

등록된 구현이 없습니다.

Tasks

FairnessSurveySystematic Literature Review

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

Similar Papers 제목 키워드 기반

Blockchain for Large Language Model Security and Safety: A Holistic Survey

2024-07-26 · Caleb Geren, Amanda Board, Gaby G. Dagher, Tim Andersen 외

With the growing development and deployment of large language models (LLMs) in both industrial and academic fields, their security and safety concerns have become increasingly critical. However, recent studies indicate t…

Data PoisoningLanguage ModelingLanguage ModellingLarge Language Model

Stop DDoS Attacking the Research Community with AI-Generated Survey Papers

2025-10-09 · Jianghao Lin, Rong Shan, Jiachen Zhu, Yunjia Xi 외 arxiv

Survey papers are foundational to the scholarly progress of research communities, offering structured overviews that guide both novices and experts across disciplines. However, the recent surge of AI-generated surveys, e…

Large Language Models for Security Operations Centers: A Comprehensive Survey

2025-09-13 · Ali Habibzadeh, Farid Feyzi, Reza Ebrahimi Atani arxiv

Large Language Models (LLMs) have emerged as powerful tools capable of understanding and generating human-like text, offering transformative potential across diverse domains. The Security Operations Center (SOC), respons…

Take Caution in Using LLMs as Human Surrogates: Scylla Ex Machina

2024-10-25 · Yuan Gao, Dokyun Lee, Gordon Burtch, Sina Fazelpour

Recent studies suggest large language models (LLMs) can exhibit human-like reasoning, aligning with human behavior in economic experiments, surveys, and political discourse. This has led many to propose that LLMs can be …

From Intentions to Techniques: A Comprehensive Taxonomy and Challenges in Text Watermarking for Large Language Models

2024-06-17 · Harsh Nishant Lalai, Aashish Anantha Ramakrishnan, Raj Sanjay Shah, Dongwon Lee

With the rapid growth of Large Language Models (LLMs), safeguarding textual content against unauthorized use is crucial. Text watermarking offers a vital solution, protecting both - LLM-generated and plain text sources. …