paper-with-me

홈 › Papers

A Security Risk Taxonomy for Prompt-Based Interaction With Large Language Models

2023-11-19 · Erik Derner, Kristina Batistič, Jan Zahálka, Robert Babuška

As large language models (LLMs) permeate more and more applications, an assessment of their associated security risks becomes increasingly necessary. The potential for exploitation by malicious actors, ranging from disinformation to data breaches and reputation damage, is substantial. This paper addresses a gap in current research by specifically focusing on security risks posed by LLMs within the prompt-based interaction scheme, which extends beyond the widely covered ethical and societal implications. Our work proposes a taxonomy of security risks along the user-model communication pipeline and categorizes the attacks by target and attack type alongside the commonly used confidentiality, integrity, and availability (CIA) triad. The taxonomy is reinforced with specific attack examples to showcase the real-world impact of these risks. Through this taxonomy, we aim to inform the development of robust and secure LLM applications, enhancing their safety and trustworthiness.

📄 PDF Abstract BibTeX arXiv:2311.11415

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMs

2024-01-12 · Yi Zeng, Hongpeng Lin, Jingwen Zhang, Diyi Yang 외

Most traditional AI safety research has approached AI models as machines and centered on algorithm-focused attacks developed by security experts. As large language models (LLMs) become increasingly common and competent, …

GrandGuard: Taxonomy, Benchmark, and Safeguards for Elderly-Chatbot Interaction Safety

2026-04-07 · Changxuan Fan, Xi Yang, Yueyuan Zheng, Bin Zhou 외 arxiv

As older adults increasingly use LLM-based chatbots for companionship and assistance, a safety gap is emerging. Older adults may face vulnerabilities from social isolation, limited digital literacy, and cognitive decline…

Securing Educational LLMs: A Generalised Taxonomy of Attacks on LLMs and DREAD Risk Assessment

2025-08-12 · Farzana Zahid, Anjalika Sewwandi, Lee Brandon, Vimal Kumar 외 arxiv

Due to perceptions of efficiency and significant productivity gains, various organisations, including in education, are adopting Large Language Models (LLMs) into their workflows. Educator-facing, learner-facing, and ins…

Cisco Integrated AI Security and Safety Framework Report

2025-12-15 · Amy Chang, Tiffany Saade, Sanket Mendapara, Adam Swanda 외 arxiv

Artificial intelligence (AI) systems are being readily and rapidly adopted, increasingly permeating critical domains: from consumer platforms and enterprise software to networked systems with embedded agents. While this …

Evaluation empirique de la sécurisation et de l'alignement de ChatGPT et Gemini: analyse comparative des vulnérabilités par expérimentations de jailbreaks

2025-06-10 · Rafaël Nouailles

Large Language models (LLMs) are transforming digital usage, particularly in text generation, image creation, information retrieval and code development. ChatGPT, launched by OpenAI in November 2022, quickly became a ref…

Information RetrievalMisinformationRetrievalText Generation