paper-with-me

홈 › Papers

Poisoning the Watchtower: Prompt Injection Attacks Against LLM-Augmented Security Operations Through Adversarial Log Content

2026-05-23 · Rohan Pandey, Archit Bhujang arxiv

Large language models (LLMs) are increasingly used as analyst assistants in security operations centers (SOCs), where they ingest log and alert data to produce triage labels, incident summaries, or remediation advice. We study a structural failure mode of this design: many log fields are attacker controlled. User agents, URLs, payloads, DNS queries, and attempted usernames can therefore carry instructions to the model alongside evidence of the intrusion. We call this setting \emph{log-substrate prompt injection}. We introduce a four-class taxonomy of log-substrate attacks: direct override (S1), persona hijack (S2), context manipulation (S3), and obfuscated payloads (S4). We evaluate 48 strategy-defense-task combinations using \texttt{gpt-4o-mini} as the analyst. Three findings stand out. First, direct overrides are ineffective in our setting: all S1 classification attacks achieve 0\% suppression. In contrast, persona hijacks suppress 68\% of malicious logs under a naive classifier and remain effective under stronger defenses. Second, summarization is the highest-risk task: context manipulation reaches 96\% injection success without defenses and 38\% even with constrained output. Third, defenses reduce but do not eliminate the attack surface: average injection success falls from 26.6\% under naive prompting to 11.8\% under our strongest defense. We also compare empirical results to a deterministic mock analyst and find that simulation substantially mispredicts current model behavior, especially for direct overrides. These results suggest that SOC copilots should treat raw log content as adversarial input rather than ordinary analyst context.

📄 PDF Abstract BibTeX arXiv:2605.24421

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

From Untrusted Input to Trusted Memory: A Systematic Study of Memory Poisoning Attacks in LLM Agents

2026-06-03 · Pritam Dash, Tongyu Ge, Aditi Jain, Tanmay Shah 외 arxiv

Memory is a core component of AI agents, enabling them to accumulate knowledge across interactions and improve performance. However, persistent memory introduces the risk of memory poisoning, where a single adversarial m…

Enhancing Prompt Injection Attacks to LLMs via Poisoning Alignment

2024-10-18 · Zedian Shao, Hongbin Liu, Jaden Mu, Neil Zhenqiang Gong

In a prompt injection attack, an attacker injects a prompt into the original one, aiming to make an LLM follow the injected prompt to perform an attacker-chosen task. Existing attacks primarily focus on how to blend the …

Cordyceps: Covert Control Attacks on LLMs via Data Poisoning

2026-05-26 · Zedian Shao, Charles Fleming, Teodora Baluta arxiv

Large language models (LLMs) are often fine-tuned on uncurated text datasets that adversaries can poison. Existing poisoning attacks primarily rely on fixed trigger phrases that defenses such as outlier detection, clean-…

Outlier Detection

System Prompt Poisoning: Persistent Attacks on Large Language Models Beyond User Injection

2025-05-10 · Jiawei Guo, Haipeng Cai

Large language models (LLMs) have gained widespread adoption across diverse applications due to their impressive generative capabilities. Their plug-and-play nature enables both developers and end users to interact with …

Logical ReasoningRAG

Exposing Citation Vulnerabilities in Generative Engines

2025-10-08 · Riku Mochizuki, Shusuke Komatsu, Souta Noguchi, Kazuto Ataka arxiv

We analyze answers generated by generative engines (GEs) from the perspectives of citation publishers and the content-injection barrier, defined as the difficulty for attackers to manipulate answers to user prompts by pl…

Answer Generation