paper-with-me

홈 › Papers

Capek 0.5: An Execution-Centric Vision-Language Model for Embodied Intelligence

2026-08-07 · Ying Chen, Weizhen Li, Zhe Hu, Zhenjiang Li, Rui Jiang, Zhifeng Gu, Lihuang Fang, Jiangping Liu, Lei Yi, Jie Chen hf

Vision-language models are increasingly serving as the reasoning core of embodied agents. Robot execution is inherently iterative: each action reshapes the scene and physical state, continually renewing what must be perceived, reasoned about, and verified. Meeting these demands requires complementary capabilities that differ in supervision signals, prediction formats, and verification criteria. Existing approaches typically develop these capabilities against isolated, task-specific objectives, leaving open how they should be organized and integrated around execution as a whole. We present Capek 0.5, an embodied vision-language model built around an execution-centric capability taxonomy. Rather than organizing training by datasets or tasks, the taxonomy groups embodied capabilities according to their functional roles throughout execution and comprises four capability families: Spatial Reasoning, Temporal Understanding, Action Guidance, and State Verification. Each capability is first acquired by a dedicated specialist through reinforcement learning with verifiable rewards from a shared backbone, and the specialists are then consolidated into a single inference-time model through weight-space merging followed by routed policy-space distillation. We instantiate Capek 0.5 at the 2B and 35B-A3B scales and evaluate it from three complementary perspectives: comprehensive benchmark suites including Capek-StateBench, a new benchmark for state verification; a controlled study of capability retention from specialists to the unified model; and closed-loop evaluation in simulated embodied environments. Capek 0.5 improves the large majority of matched benchmark rows over its initialization, retains all four specialized capabilities in one checkpoint with quantified losses, and transfers to closed-loop embodied task execution.

📄 PDF Abstract BibTeX arXiv:2608.06756

Code (3)

Aaron617/agent-arXiv-daily ★ 10
BaiShuanghao/my_arXiv_daily ★ 208
Tavish9/awesome-daily-AI-arxiv ★ 113

Tasks

Reinforcement LearningSpatial Reasoning

Similar Papers 제목 키워드 기반

OPEx: A Component-Wise Analysis of LLM-Centric Agents in Embodied Instruction Following

2024-03-05 · Haochen Shi, Zhiyuan Sun, Xingdi Yuan, Marc-Alexandre Côté 외

Embodied Instruction Following (EIF) is a crucial task in embodied learning, requiring agents to interact with their environment through egocentric observations to fulfill natural language instructions. Recent advancemen…

Instruction Following

HyCodePolicy: Hybrid Language Controllers for Multimodal Monitoring and Decision in Embodied Agents

2025-08-04 · Yibin Liu, Zhixuan Liang, Zanxin Chen, Tianxing Chen 외 arxiv

Recent advances in multimodal large language models (MLLMs) have enabled richer perceptual grounding for code policy generation in embodied agents. However, most existing systems lack effective mechanisms to adaptively m…

Multimodal ReasoningRobot ManipulationProgram Synthesis

Towards the Vision-Sound-Language-Action Paradigm: The HEAR Framework for Sound-Centric Manipulation

2026-03-17 · Chang Nie, Tianchen Deng, Guangming Wang, Zhe Liu 외 arxiv

While recent Vision-Language-Action (VLA) models have begun to incorporate audio, they typically treat sound as static pre-execution prompts or focus exclusively on human speech. This leaves a significant gap in real-tim…

Continuous Control

ESPIRE: A Diagnostic Benchmark for Embodied Spatial Reasoning of Vision-Language Models

2026-03-13 · Yanpeng Zhao, Wentao Ding, Hongtao Li, Baoxiong Jia 외 arxiv

A recent trend in vision-language models (VLMs) has been to enhance their spatial cognition for embodied domains. Despite progress, existing evaluations have been limited both in paradigm and in coverage, hindering rapid…

Question AnsweringSpatial Reasoning

HumanScale: Egocentric Human Video Can Outperform Real-Robot Data for Embodied Pretraining

2026-06-18 · Juncheng Ma, Jianxin Bi, Yufan Deng, Xuanran Zhai 외 arxiv

Embodied foundation models are expected to benefit from data scaling like large language models, but face a much tighter data bottleneck. Teleoperated real-robot trajectories remain the dominant pretraining source due to…