paper-with-me

홈 › Papers

VLA-Trace: Diagnosing Vision-Language-Action Models through Representation and Behavior Tracing

2026-05-28 · Haoyuan Shi, Xiancong Ren, Yingji Zhang, Qinfan Zhang, Jiayu Hu, Haozhe Shan, Han Dong, Jinpeng Lu, Yinda Chen, Yi Zhang, Yong Dai, Xiaozhu Ju arxiv

Understanding how Vision-Language-Action (VLA) models transform multimodal knowledge into embodied control remains an open challenge. We present VLA-Trace, a progressive diagnostic framework that analyzes VLA models through a unified evidence chain from representation dynamics to causal control attribution and behavioral manifestation. It specifically combines cross-modal and checkpoint-drift centered kernel alignment (CKA) to trace representation evolution, attention knockout interventions to identify modality-specific control pathways, and rollout-level behavioral probes to examine grounding, shortcut dependence, and semantic following. Experiments on $π_{0.5}$ and OpenVLA reveal three key findings. First, the two models exhibit distinct modality-specific adaptation dynamics during VLA finetuning. Second, they rely on different multimodal routing strategies and layer-wise dependencies during action decoding. Third, although VLA policies excel at visually grounded trajectory generation, they remain limited in fine-grained semantic following. These findings highlight future directions for representation-preserving adaptation, causal VLA circuits, and compositional semantic control.

📄 PDF Abstract BibTeX arXiv:2605.30117

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

REFLECT: Intervention-Supported Error Attribution for Silent Failures in LLM Agent Traces

2026-06-08 · Xiaofeng Lin, Yingxu Wang, Tung Sum Thomas Kwok, Daniel Guo 외 arxiv

Large language model (LLM) agents now solve complex tasks through long plan-and-execution traces, yet the ability to locate errors in a completed traces still lags far behind, especially in the \emph{silent failure} regi…

Diagnosing Semantic Handoff Failures in Agent-Orchestrated Vision-Language-Action Skill Composition

2026-07-07 · Ke Rui, Yushen Zuo, Jiawei Wang, Haoran Jia 외 arxiv

Long-horizon household tasks require robots to compose many language-conditioned skills, yet the boundary between consecutive skills is rarely explicit. A skill may satisfy its own postcondition while leaving the robot, …

RoboSemanticBench: Diagnosing Semantic Grounding in Action Prediction for VLA Models

2026-06-01 · Bin Yu, Yao Zhang, Haishan Liu, Shijie Lian 외 arxiv

Vision-language-action (VLA) models are built on the premise that semantic understanding from pretrained language or vision-language backbones should guide robot action prediction. Yet robot fine-tuning is optimized as i…

AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?

2025-09-03 · Guibin Zhang, Junhao Wang, Junjie Chen, Wangchunshu Zhou 외 arxiv

Large Language Model (LLM)-based agentic systems, often comprising multiple models, complex tool invocations, and orchestration protocols, substantially outperform monolithic agents. Yet this very sophistication amplifie…

Reinforcement Learning

Beyond Input Understanding: Diagnosing Multilingual Mathematical Reasoning with Directed Acyclic Trace Graphs

2026-05-26 · Jiaqiao Zhang, Zhoujun Li, Raoyuan Zhao, Jian Lan 외 arxiv

Large reasoning models (LRMs) achieve strong mathematical reasoning performance in English, but remain much less reliable in many low- and medium-resource languages. This gap is often explained as a failure to understand…

Mathematical Reasoning