paper-with-me

Papers

Path Drift in Large Reasoning Models:How First-Person Commitments Override Safety

2025-10-11 · Yuyi Huang, Runzhe Zhan, Lidia S. Chao, Ailin Tao, Derek F. Wong arxiv

As large language models (LLMs) are increasingly deployed for complex reasoning tasks, Long Chain-of-Thought (Long-CoT) prompting has emerged as a key paradigm for structured inference. Despite early-stage safeguards enabled by alignment techniques such as RLHF, we identify a previously underexplored vulnerability: reasoning trajectories in Long-CoT models can drift from aligned paths, resulting in content that violates safety constraints. We term this phenomenon Path Drift. Through empirical analysis, we uncover three behavioral triggers of Path Drift: (1) first-person commitments that induce goal-driven reasoning that delays refusal signals; (2) ethical evaporation, where surface-level disclaimers bypass alignment checkpoints; (3) condition chain escalation, where layered cues progressively steer models toward unsafe completions. Building on these insights, we introduce a three-stage Path Drift Induction Framework comprising cognitive load amplification, self-role priming, and condition chain hijacking. Each stage independently reduces refusal rates, while their combination further compounds the effect. To mitigate these risks, we propose a path-level defense strategy incorporating role attribution correction and metacognitive reflection (reflective safety cues). Our findings highlight the need for trajectory-level alignment oversight in long-form reasoning beyond token-level alignment.

📄 PDF Abstract BibTeX arXiv:2510.10013

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

DRIFTLENS: Measuring Memory-Induced Reasoning Drift in Personalized Language Models

2026-07-02 · Xi Fang, Weijie Xu, Yingqiang Ge, Yuhui Xu 외 arxiv

Personalization changes what a model says to a user; we show that it can also change the reasoning trajectory used to justify the response. Modern LLMs personalize interactions by storing user attributes, preferences, an…

Instruction Following

AnE: Pushing the Reasoning Frontier of Multimodal LLMs via Anchor Evolution

2026-05-25 · Zehao Wang, Yihan Zeng, Zidong Gong, Yuanfan Guo 외 arxiv

Post-training via Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL) is crucial for enhancing reasoning in Multimodal Large Language Models (MLLMs), yet existing paradigms often reach a performance bottleneck d…

Reinforcement LearningMultimodal Reasoning

LLMs Think, But Not In Your Flow: Reasoning-Level Personalization for Black-Box Large Language Models

2025-05-27 · Jieyong Kim, Tongyoung Kim, Soojin Yoon, Jaehyung Kim 외

Large language models (LLMs) have recently achieved impressive performance across a wide range of natural language tasks and are now widely used in real-world applications. Among them, black-box LLMs--served via APIs wit…

Enhancing LLM Reasoning via Non-Human-Like Reasoning Path Preference Optimization

2025-10-13 · Junjie Lu, Yuliang Liu, Chaofeng Qu, Wei Shen 외 arxiv

Current approaches for strengthening LLM reasoning tend to introduce a training bias toward human-like reasoning trajectories. In step-wise preference optimization, in particular, dependence on human or higher-capacity m…

Mathematical Reasoning

Reasoning-Enhanced Self-Training for Long-Form Personalized Text Generation

2025-01-07 · Alireza Salemi, Cheng Li, Mingyang Zhang, Qiaozhu Mei 외

Personalized text generation requires a unique ability of large language models (LLMs) to learn from context that they often do not encounter during their standard training. One way to encourage LLMs to better use person…

FormResponse GenerationText Generation