paper-with-me

홈 › Papers

Bootstrapped Monitoring: Leveraging Transparent Reasoning to Oversee Stronger AI Agents

2026-06-10 · Frank Xiao, Mary Phuong arxiv

Trusted monitoring is a cornerstone of AI control. However, as frontier models grow more capable, the increasing capabilities gap between trusted and untrusted models may render trusted models unreliable monitors. We introduce \emph{bootstrapped monitoring}, a protocol that addresses this by inserting a stronger, intermediate untrusted model with transparent chain-of-thought reasoning into the oversight chain. The untrusted monitor ($U_m$) evaluates the agent's actions, while a weaker trusted model ($T$) oversees $U_m$'s reasoning to detect collusion. We evaluate bootstrapped monitoring on multi-turn software engineering tasks (BashArena) across multiple agents and monitors. Bootstrapped monitoring substantially improves catch rates over trusted-only monitoring, even when the untrusted monitor actively colludes with the agent, provided we have access to its raw chain-of-thought. Our results suggest that bootstrapped monitoring can extend the useful lifetime of trusted models in control as AI capabilities advance.

📄 PDF Abstract BibTeX arXiv:2606.11998

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

CoT Red-Handed: Stress Testing Chain-of-Thought Monitoring

2025-05-29 · Benjamin Arnav, Pablo Bernabeu-Pérez, Nathan Helm-Burger, Tim Kostolansky 외

As AI models are deployed with increasing autonomy, it is important to ensure they do not take harmful actions unnoticed. As a potential mitigation, we investigate Chain-of-Thought (CoT) monitoring, wherein a weaker trus…

Red Teaming

Noticing the Watcher: LLM Agents Can Infer CoT Monitoring from Blocking Feedback

2026-03-14 · Thomas Jiralerspong, Flemming Kondrup, Yoshua Bengio arxiv

Chain-of-thought (CoT) monitoring is proposed as a method for overseeing the internal reasoning of language-model agents. Prior work has shown that when models are explicitly informed that their reasoning is being monito…

Aligned, Orthogonal or In-conflict: When can we safely optimize Chain-of-Thought?

2026-03-31 · Max Kaufmann, David Lindner, Roland S. Zimmermann, and Rohin Shah arxiv

Chain-of-Thought (CoT) monitoring, in which automated systems monitor the CoT of an LLM, is a promising approach for effectively overseeing AI systems. However, the extent to which a model's CoT helps us oversee the mode…

Practical challenges of control monitoring in frontier AI deployments

2025-12-15 · David Lindner, Charlie Griffin, Tomek Korbak, Roland S. Zimmermann 외 arxiv

Automated control monitors could play an important role in overseeing highly capable AI agents that we do not fully trust. Prior work has explored control monitoring in simplified settings, but scaling monitoring to real…

Control and Monitoring of Artificial Intelligence Algorithms

2023-07-24 · Carlos Mario Braga Ortuño, Blanza Martinez Donoso, Belén Muñiz Villanueva

This paper elucidates the importance of governing an artificial intelligence model post-deployment and overseeing potential fluctuations in the distribution of present data in contrast to the training data. The concepts …