paper-with-me

Papers

Dense Policy: Bidirectional Autoregressive Learning of Actions

2025-03-17 · Yue Su, Xinyu Zhan, Hongjie Fang, Han Xue, Hao-Shu Fang, Yong-Lu Li, Cewu Lu, Lixin Yang

Mainstream visuomotor policies predominantly rely on generative models for holistic action prediction, while current autoregressive policies, predicting the next token or chunk, have shown suboptimal results. This motivates a search for more effective learning methods to unleash the potential of autoregressive policies for robotic manipulation. This paper introduces a bidirectionally expanded learning approach, termed Dense Policy, to establish a new paradigm for autoregressive policies in action prediction. It employs a lightweight encoder-only architecture to iteratively unfold the action sequence from an initial single frame into the target sequence in a coarse-to-fine manner with logarithmic-time inference. Extensive experiments validate that our dense policy has superior autoregressive learning capabilities and can surpass existing holistic generative policies. Our policy, example data, and training code will be publicly available upon publication. Project page: https: //selen-suyue.github.io/DspNet/.

📄 PDF Abstract BibTeX arXiv:2503.13217

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Data-Efficient Autoregressive-to-Diffusion Language Models via On-Policy Distillation

2026-06-04 · Xingyu Su, Jacob Helwig, Shubham Parashar, Atharv Chagi 외 arxiv

We study the transformation of autoregressive models (ARLMs) into diffusion language models (DLMs). Rather than pretraining from scratch, prior work replaces the causal attention in ARLMs with bidirectional attention and…

JanusDNA: A Powerful Bi-directional Hybrid DNA Foundation Model

2025-05-22 · Qihao Duan, Bingding Huang, Zhenqiao Song, Irina Lehmann 외

Large language models (LLMs) have revolutionized natural language processing and are increasingly applied to other sequential data types, including genetic sequences. However, adapting LLMs to genomics presents significa…

GPULong-range modelingMambaMixture-of-Experts

World Models via Policy-Guided Trajectory Diffusion

2023-12-13 · Marc Rigter, Jun Yamada, Ingmar Posner

World models are a powerful tool for developing intelligent agents. By predicting the outcome of a sequence of actions, world models enable policies to be optimised via on-policy reinforcement learning (RL) using synthet…

continuous-controlContinuous ControlDenoisingMuJoCo+2

ROAD-VLA: Robust Online Adaptation via Self-Distillation for Vision-Language-Action Models

2026-06-24 · Kejing Wang, Toan Nguyen, Minh Hoang Nguyen, Simon Khan 외 arxiv

Effective online adaptation of vision-language-action (VLA) models remains challenging, as sparse rewards provide weak supervision for high-dimensional autoregressive action policies. Although self-distillation can in pr…

HiFlow: Tokenization-Free Scale-Wise Autoregressive Policy Learning via Flow Matching

2026-03-28 · Daichi Yashima, Koki Seno, Shuhei Kurita, Yusuke Oda 외 arxiv

Coarse-to-fine autoregressive modeling has recently shown strong promise for visuomotor policy learning, combining the inference efficiency of autoregressive methods with the global trajectory coherence of diffusion-base…

Image Generation