paper-with-me

Papers

Current state of LLM Risks and AI Guardrails

2024-06-16 · Suriya Ganesh Ayyamperumal, Limin Ge

Large language models (LLMs) have become increasingly sophisticated, leading to widespread deployment in sensitive applications where safety and reliability are paramount. However, LLMs have inherent risks accompanying them, including bias, potential for unsafe actions, dataset poisoning, lack of explainability, hallucinations, and non-reproducibility. These risks necessitate the development of "guardrails" to align LLMs with desired behaviors and mitigate potential harm. This work explores the risks associated with deploying LLMs and evaluates current approaches to implementing guardrails and model alignment techniques. We examine intrinsic and extrinsic bias evaluation methods and discuss the importance of fairness metrics for responsible AI development. The safety and reliability of agentic LLMs (those capable of real-world actions) are explored, emphasizing the need for testability, fail-safes, and situational awareness. Technical strategies for securing LLMs are presented, including a layered protection model operating at external, secondary, and internal levels. System prompts, Retrieval-Augmented Generation (RAG) architectures, and techniques to minimize bias and protect privacy are highlighted. Effective guardrail design requires a deep understanding of the LLM's intended use case, relevant regulations, and ethical considerations. Striking a balance between competing requirements, such as accuracy and privacy, remains an ongoing challenge. This work underscores the importance of continuous research and development to ensure the safe and responsible use of LLMs in real-world applications.

📄 PDF Abstract BibTeX arXiv:2406.12934

Code (0)

등록된 구현이 없습니다.

Tasks

FairnessRAGRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

SafePred: A Predictive Guardrail for Computer-Using Agents via World Models

2026-02-02 · Yurun Chen, Zeyi Liao, Ping Yin, Taotao Xie 외 arxiv

With the widespread deployment of Computer-using Agents (CUAs) in complex real-world environments, prevalent long-term risks often lead to severe and irreversible consequences. Most existing guardrails for CUAs adopt a r…

Building Guardrails for Large Language Models

2024-02-02 · Yi Dong, Ronghui Mu, Gaojie Jin, Yi Qi 외

As Large Language Models (LLMs) become more integrated into our daily lives, it is crucial to identify and mitigate their risks, especially when the risks can have profound impacts on human users and societies. Guardrail…

DreamGuard: Efficient Runtime Guardrail for LLM Agents via Risk-Aware World Model

2026-08-06 · Wenhao Lin, Chenyu Yu, Xingwei Lin, Sicong Cao 외 arxiv

As large language model (LLM) agents increasingly invoke external tools and interact with real-world systems, unsafe actions may cause irreversible consequences on external states, user data, and downstream services. Rec…

Triaging Threats to Specialized Guardrails

2026-05-29 · Wenjie Jacky Mo, Xiaofei Wen, Rui Cai, Boyu Zhu 외 arxiv

Building robust safety guardrails is essential for deploying Large Language Models across diverse real-world applications. However, this goal remains challenging because safety risks span heterogeneous threat domains, wh…

PSG-Agent: Personality-Aware Safety Guardrail for LLM-based Agents

2025-09-28 · Yaozu Wu, Jizhou Guo, Dongyuan Li, Henry Peng Zou 외 arxiv

Effective guardrails are essential for safely deploying LLM-based agents in critical applications. Despite recent advances, existing guardrails suffer from two fundamental limitations: (i) they apply uniform guardrail po…