paper-with-me

홈 › Papers

ActProbe: Action-Space Probe for Early Failure Detection of Generative Robot Policies

2026-06-07 · Bingjia Huang, Xiangyu Li, Xiang Wang, Liang Mi, Zixu Hao, Weijun Wang, Hao Wu, Kun Li, Yunxin Liu, Ting Cao arxiv

Generative robot policies fail unpredictably at deployment: they hesitate at critical moments, drift off-task, or commit to unrecoverable actions. Existing online failure detectors either require white-box access to policy internals or add runtime overhead through resampling and observation-side signals. Our empirical analysis shows that emitted action chunks themselves already carry strong predictive signal for impending failures in generative robot policies. Motivated by this observation, we introduce ActProbe, a lightweight, pure action-space detector that uses two compact signals available from a single forward pass: Temporal Consistency Error (TCE) between consecutive action chunks and Action Chunk Magnitude (ACM) of the current chunk. ActProbe maps these signals to per-step failure probabilities with a task-conditioned LSTM-MLP architecture. Across a diverse suite of generative robot policies and benchmarks, ActProbe raises alerts before failures become visually recognizable, improving the accuracy (F1)-timeliness Pareto frontier of failure detection by an average hypervolume gain of +12.7% over both internal- and external-feature baselines, with a +9.0% early-detection ROC-AUC lead on unseen tasks. ActProbe further transfers to deployment, predicting failures on unseen real-robot pick tasks and accelerating RL fine-tuning (PPO) with 2.9x fewer environment interactions.

📄 PDF Abstract BibTeX arXiv:2606.08508

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Doomed from the Start: Early Abort of LLM Agent Episodes via a Recall-Controlled Probe Cascade

2026-07-07 · Kai Ruan, Zihe Huang, Ziqi Zhou, Qianshan Wei 외 arxiv

Large language model (LLM) agents often waste inference compute by continuing multi-step trajectories that are already doomed to fail. We study early failure prediction and inference-time early stopping for LLM agents us…

Early Warning Signals for OpenVLA Failure under Visual Distribution Shift

2026-06-29 · Dipesh Tharu Mahato, Rachel Ren arxiv

Vision Language Action models combine perception, language grounding, and control in a single policy, but their failures are hard to diagnose once visual conditions shift. We test whether OpenVLA feedforward activations …

Before the Last Token: Diagnosing Final-Token Safety Probe Failures

2026-05-12 · Shravan Doda arxiv

Final-token safety probes monitor a single hidden state after prompt prefill, but jailbreak prompts can contain probe-visible unsafe evidence distributed across earlier user-token representations that is missed by this r…

TherapyProbe: Generating Design Knowledge for Relational Safety in Mental Health Chatbots Through Adversarial Simulation

2026-02-26 · Joydeep Chandra, Satyam Kumar Navneet, Yong Zhang arxiv

As mental health chatbots proliferate to address the global treatment gap, a critical question emerges: How do we design for relational safety the quality of interaction patterns that unfold across conversations rather t…

ProbeAct: Probe-Guided Training-Free Failure Recovery in Vision-Language-Action Models

2026-06-08 · Fan Zhang, Seongbin Park, Baharan Mirzasoleiman, Shariar Talebi 외 arxiv

Vision-Language-Action (VLA) models demonstrate strong perfor-1 mance on language-conditioned robotic manipulation within their training dis-2 tribution, yet their generalization capabilities remain fundamentally limited…