paper-with-me

홈 › Papers

Decoupled Action Expert: Confining Task Knowledge to the Conditioning Pathway

2025-11-15 · Jian Zhou, Sihao Lin, Shuai Fu, Zerui Li, Gengze Zhou, Qi WU arxiv

Many recent Vision-Language-Action models employ diffusion or flow-matching backbones with hundreds of millions of parameters for action generation. However, unlike image synthesis where the output spans millions of diverse pixels, a manipulation policy generates only short sequences of low-dimensional, physically correlated action values, a far simpler target that should not demand such capacity. We confirm this intuition and show that task-specific knowledge in these policies can be fully confined to the conditioning pathway, leaving the action backbone task-agnostic. To establish this, we introduce a decoupled training recipe: a general-purpose action head is first pretrained on observation-free forward-kinematics data, then frozen while only the conditioning pathway is trained for downstream tasks. Using Diffusion Policy as a testbed, we show that on both MimicGen and LIBERO, a single frozen backbone shared across all tasks matches normally trained counterparts. This confirms that the action expert encodes little task-specific knowledge. Ablations show that the specific pretraining signal (joint positions, end-effector poses, or no conditioning at all) has no effect on downstream performance, indicating that the backbone learns only general trajectory structure. Pushing this finding further, we replace the 244M U-Net in Diffusion Policy with a 5M-parameter MLP backbone that matches or exceeds its performance, calling into question the large capacity budgets allocated to action generation in current VLA designs.

📄 PDF Abstract BibTeX arXiv:2511.12101

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Plan Your Target and Learn Your Skills: Transferable State-Only Imitation Learning via Decoupled Policy Optimization

2022-03-04 · Minghuan Liu, Zhengbang Zhu, Yuzheng Zhuang, Weinan Zhang 외

Recent progress in state-only imitation learning extends the scope of applicability of imitation learning to real-world settings by relieving the need for observing expert actions. However, existing solutions only learn …

Imitation LearningTransfer Learning

MoG: Mixture of Experts for Graph-based Retrieval-Augmented Generation

2026-05-29 · Zheng Yuan, Chuang Zhou, Linhao Luo, Siyu An 외 arxiv

Retrieval-augmented generation is intensively studied to ground large language models on external evidence. However, retrieving from a unified knowledge base could inevitably introduce irrelevant information that may mis…

Decoupled Mixture-of-Experts for Parametric Knowledge Injection

2026-06-12 · Baoqing Yue, Weihang Su, Qingyao Ai, Yichen Tang 외 arxiv

Knowledge injection aims to equip large language models (LLMs) with external, domain-specific, or time-sensitive knowledge. Existing approaches typically face a trade-off between flexibility and integration: retrieval-au…

Path-Decoupled Hyperbolic Flow Matching for Few-Shot Adaptation

2026-02-24 · Lin Li, Ziqi Jiang, Gefan Ye, Zhenqi He 외 arxiv

Recent advances in cross-modal few-shot adaptation treat visual-semantic alignment as a continuous feature transport problem via Flow Matching (FM). However, we argue that Euclidean-based FM overlooks fundamental limitat…

HyLaR: Hybrid Latent Reasoning with Decoupled Policy Optimization

2026-04-22 · Tao Cheng, Shi-Zhe Chen, Hao Zhang, Yixin Qin 외 arxiv

Chain-of-Thought (CoT) reasoning significantly elevates the complex problem-solving capabilities of multimodal large language models (MLLMs). However, adapting CoT to vision typically discretizes signals to fit LLM input…

Reinforcement LearningText Generation