paper-with-me

홈 › Papers

Emergent Neural Automaton Policies: Learning Symbolic Structure from Visuomotor Trajectories

2026-03-26 · Yiyuan Pan, Xusheng Luo, Hanjiang Hu, Peiqi Yu, Changliu Liu arxiv

Scaling robot learning to long-horizon tasks remains a formidable challenge. While end-to-end policies often lack the structural priors needed for effective long-term reasoning, traditional neuro-symbolic methods rely heavily on hand-crafted symbolic priors. To address the issue, we introduce ENAP (Emergent Neural Automaton Policy), a framework that allows a bi-level neuro-symbolic policy adaptively emerge from visuomotor demonstrations. Specifically, we first employ adaptive clustering and an extension of the L* algorithm to infer a Mealy state machine from visuomotor data, which serves as an interpretable high-level planner capturing latent task modes. Then, this discrete structure guides a low-level reactive residual network to learn precise continuous control via behavior cloning (BC). By explicitly modeling the task structure with discrete transitions and continuous residuals, ENAP achieves high sample efficiency and interpretability without requiring task-specific labels. Extensive experiments on complex manipulation and long-horizon tasks demonstrate that ENAP outperforms state-of-the-art (SoTA) end-to-end VLA policies by up to 27% in low-data regimes, while offering a structured representation of robotic intent (Fig. 1).

📄 PDF Abstract BibTeX arXiv:2603.25903

Code (0)

등록된 구현이 없습니다.

Tasks

Continuous Control

Similar Papers 제목 키워드 기반

Automaton Distillation: Neuro-Symbolic Transfer Learning for Deep Reinforcement Learning

2023-10-29 · Suraj Singireddy, Precious Nwaorgu, Andre Beckus, Aden McKinney 외

Reinforcement learning (RL) is a powerful tool for finding optimal policies in sequential decision processes. However, deep RL methods have two weaknesses: collecting the amount of agent experience required for practical…

Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1

Inference-Time Robot Behavior Steering through Physically-Aware Reconfiguration of Task-Structure

2026-06-25 · Yiyuan Pan, Hanjiang Hu, Shangtao Li, Xusheng Luo 외 arxiv

A central challenge in deploying learned robot policies is inference-time behavior steering: redirecting a policy at test time to satisfy user preferences not anticipated during training, without retraining. Existing met…

Learning Structured Robot Policies from Vision-Language Models via Synthetic Neuro-Symbolic Supervision

2026-04-03 · Alessandro Adami, Tommaso Tubaldo, Marco Todescato, Ruggero Carli 외 arxiv

Vision-Language Models (VLMs) have recently demonstrated strong capabilities in mapping multimodal observations to robot behaviors. However, most current approaches rely on end-to-end visuomotor policies that remain opaq…

Decompose and Reorganize: Planning with Primitives and Visuomotor Policies Learned from Demonstrations

2026-07-28 · Yizhou Chen, Hang Xu, Dongjie Yu, Yupu Lu 외 arxiv

Successfully automating dexterous, long-horizon robotic manipulation requires frameworks capable of both high-level reasoning and fine-grained execution. Traditional task and motion planning (TAMP), while excellent at sy…

Motion Planning

Noisy Symbolic Abstractions for Deep RL: A case study with Reward Machines

2022-11-20 · Andrew C. Li, Zizhao Chen, Pashootan Vaezipoor, Toryn Q. Klassen 외

Natural and formal languages provide an effective mechanism for humans to specify instructions and reward functions. We investigate how to generate policies via RL when reward functions are specified in a symbolic langua…