paper-with-me

Papers

ShadowCoT: Cognitive Hijacking for Stealthy Reasoning Backdoors in LLMs

2025-04-08 · Gejian Zhao, Hanzhou Wu, Xinpeng Zhang, Athanasios V. Vasilakos

Chain-of-Thought (CoT) enhances an LLM's ability to perform complex reasoning tasks, but it also introduces new security issues. In this work, we present ShadowCoT, a novel backdoor attack framework that targets the internal reasoning mechanism of LLMs. Unlike prior token-level or prompt-based attacks, ShadowCoT directly manipulates the model's cognitive reasoning path, enabling it to hijack multi-step reasoning chains and produce logically coherent but adversarial outcomes. By conditioning on internal reasoning states, ShadowCoT learns to recognize and selectively disrupt key reasoning steps, effectively mounting a self-reflective cognitive attack within the target model. Our approach introduces a lightweight yet effective multi-stage injection pipeline, which selectively rewires attention pathways and perturbs intermediate representations with minimal parameter overhead (only 0.15% updated). ShadowCoT further leverages reinforcement learning and reasoning chain pollution (RCP) to autonomously synthesize stealthy adversarial CoTs that remain undetectable to advanced defenses. Extensive experiments across diverse reasoning benchmarks and LLMs show that ShadowCoT consistently achieves high Attack Success Rate (94.4%) and Hijacking Success Rate (88.4%) while preserving benign performance. These results reveal an emergent class of cognition-level threats and highlight the urgent need for defenses beyond shallow surface-level consistency.

📄 PDF Abstract BibTeX arXiv:2504.05605

Code (0)

등록된 구현이 없습니다.

Tasks

Backdoor Attack

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Decision-Level Hijacking: Injecting Cognitive Bias into Large Language Models via Bit-Flip Attacks

2026-07-28 · Yu Yan, Jiahao Chen, Siqi Lu, Yongjuan Wang 외 arxiv

Large Language Models (LLMs) have been widely applied in high-stakes decision-making scenarios such as corporate strategy, and users are increasingly relying on their outputs. However, the deep integration of open-source…

Stealthy Backdoors as Compression Artifacts

2021-04-30 · Yulong Tian, Fnu Suya, Fengyuan Xu, David Evans

In a backdoor attack on a machine learning model, an adversary produces a model that performs well on normal inputs but outputs targeted misclassifications on inputs containing a small trigger pattern. Model compression …

Backdoor AttackModel CompressionQuantization

Reasoning Introduces New Poisoning Attacks Yet Makes Them More Complicated

2025-09-06 · Hanna Foerster, Ilia Shumailov, Yiren Zhao, Harsh Chaudhari 외 arxiv

Early research into data poisoning attacks against Large Language Models (LLMs) demonstrated the ease with which backdoors could be injected. More recent LLMs add step-by-step reasoning, expanding the attack surface to i…

Answer Generation

Get a Model! Model Hijacking Attack Against Machine Learning Models

2021-11-08 · Ahmed Salem, Michael Backes, Yang Zhang

Machine learning (ML) has established itself as a cornerstone for various critical applications ranging from autonomous driving to authentication systems. However, with this increasing adoption rate of machine learning m…

Autonomous DrivingBIG-bench Machine LearningData PoisoningDecoder+1

Bilateral Cognitive Security Games in Networked Control Systems under Stealthy Injection Attacks

2025-05-02 · Anh Tung Nguyen, Quanyan Zhu, André Teixeira

This paper studies a strategic security problem in networked control systems under stealthy false data injection attacks. The security problem is modeled as a bilateral cognitive security game between a defender and an a…