paper-with-me

홈 › Papers

Pre-Execution Safety Gate & Task Safety Contracts for LLM-Controlled Robot Systems

2026-04-07 · Ike Obi, Vishnunandan L. N. Venkatesh, Weizheng Wang, Ruiqi Wang, Dayoon Suh, Temitope I. Amosa, Wonse Jo, Byung-Cheol Min arxiv

Large Language Models (LLMs) are increasingly used to convert task commands into robot-executable code, however this pipeline lacks validation gates to detect unsafe and defective commands before they are translated into robot code. Furthermore, even commands that appear safe at the outset can produce unsafe state transitions during execution in the absence of continuous constraint monitoring. In this research, we introduce SafeGate, a neurosymbolic safety architecture that prevents unsafe natural language task commands from reaching robot execution. Drawing from ISO 13482 safety standard, SafeGate extracts structured safety-relevant properties from natural language commands and applies a deterministic decision gate to authorize or reject execution. In addition, we introduce Task Safety Contracts, which decomposes commands that pass through the gate into invariants, guards, and abort conditions to prevent unsafe state transitions during execution. We further incorporate Z3 SMT solving to enforce constraint checking derived from the Task Safety Contracts. We evaluate SafeGate against existing LLM-based robot safety frameworks and baseline LLMs across 230 benchmark tasks, 30 AI2-THOR simulation scenarios, and real-world robot experiments. Results show that SafeGate significantly reduces the acceptance of defective commands while maintaining a high acceptance of benign tasks, demonstrating the importance of pre-execution safety gates for LLM-controlled robot systems

📄 PDF Abstract BibTeX arXiv:2604.05427

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Bounded Autonomy for Enterprise AI: Typed Action Contracts and Consumer-Side Execution

2026-04-16 · Sarmad Sohail, Ghufran Haider arxiv

Large language models are increasingly used as natural-language interfaces to enterprise software, but their direct use as system operators remains unsafe. Model errors can propagate into unauthorized actions, malformed …

ClawProBench: Trace-Aware Evaluation of AI Agents with Runtime Coverage and Frozen Workplace-Style Holdouts

2026-08-23 · YuanHang Xiao hf

Agent benchmarks often evaluate only final answers even when agents run on stateful runtimes. We argue this under-specifies what is being evaluated: the proper unit is a declared model-plus-runtime configuration whose fa…

Refining Perception Contracts: Case Studies in Vision-based Safe Auto-landing

2023-11-15 · Yangge Li, Benjamin C Yang, Yixuan Jia, Daniel Zhuang 외

Perception contracts provide a method for evaluating safety of control systems that use machine learning for perception. A perception contract is a specification for testing the ML components, and it gives a method for p…

OpenKedge: Governing Agentic Mutation with Execution-Bound Safety and Evidence Chains

2026-04-07 · Jun He, Deying Yu arxiv

The rise of autonomous AI agents exposes a fundamental flaw in API-centric architectures: probabilistic systems directly execute state mutations without sufficient context, coordination, or safety guarantees. We introduc…

A contract negotiation scheme for safety verification of interconnected systems

2023-11-06 · Xiao Tan, Antonis Papachristodoulou, Dimos V. Dimarogonas

This paper proposes a (control) barrier function synthesis and safety verification scheme for interconnected nonlinear systems based on assume-guarantee contracts (AGC) and sum-of-squares (SOS) techniques. It is well-kno…