paper-with-me

Papers

Learning Foresight without Explicit Trajectories for 3D Diffusion Policies

2026-09-17 · Zhongbo Zhang, Zaibin Zhang, Yifan Wang, Changbo Yan, Lijun Wang, Huchuan Lu hf

3D diffusion policies are strong at generating geometrically grounded actions from current observations, but successful manipulation requires not only knowing what motion is feasible now, but also anticipating where the interaction is heading. Existing policies largely leave such foresight to emerge implicitly from action learning. We introduce Movement Trend Guidance, a simple but effective way to provide this foresight without introducing an explicit plan. From a short observation history, the policy learns a compact latent representation of interaction evolution. During training, sparse future gripper states supervise this representation; at inference, only the latent is retained as future-oriented conditioning alongside the current observation. The latent provides global conditioning for action generation, while an additional gated FiLM branch is used only at the UNet bottleneck. Despite adding only 3.52% more parameters to DP3, our method preserves the original dense-action and receding-horizon formulation and consistently improves upon DP3 across RoboTwin2.0, LIBERO-40, and DexArt. It reaches 62.8% vs. 56.1% in 50-task RoboTwin2.0 mixed training, 71.93% vs. 37.08% on LIBERO-40, and 72.0% vs. 49.0% on five real-robot tasks. These results show that a diffusion policy can benefit substantially from knowing where an interaction is heading, without being told exactly where to move.

📄 PDF Abstract BibTeX arXiv:2609.20669

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

WAM-Nav: Asymmetric Latent World-Action Modeling for Unified Visual Navigation

2026-06-03 · Ning Yang, Yan Huang, Kaiwen Peng, Ziheng He 외 arxiv

Visual navigation requires generating smooth and collision-free trajectories under complex geometric and physical constraints. Existing reactive policies that directly map observations to actions lack anticipatory reason…

Visual Navigation

UniNav: A Unified World-Action Diffusion Model for Visual Navigation

2026-08-04 · Changqing Zhou, Yueru Luo, Zeyu Jiang, Changhao Chen arxiv

Image-goal visual navigation is a fundamental capability for embodied agents. Existing navigation policies efficiently predict waypoint trajectories but lack visual foresight, while navigation world models can anticipate…

Trajectory PredictionVisual Navigation

ObjectForesight: Predicting Future 3D Object Trajectories from Human Videos

2026-01-08 · Rustin Soraki, Homanga Bharadhwaj, Ali Farhadi, Roozbeh Mottaghi arxiv

Humans can effortlessly anticipate how objects might move or change through interaction--imagining a cup being lifted, a knife slicing, or a lid being closed. We aim to endow computational systems with a similar ability …

3D Pose Estimation

From Hindsight to Foresight: Self-Encouraged Hindsight Distillation for Knowledge-based Visual Question Answering

2025-11-14 · Yu Zhao, Ying Zhang, Xuhui Sui, Baohang Zhou 외 arxiv

Knowledge-based Visual Question Answering (KBVQA) necessitates external knowledge incorporation beyond cross-modal understanding. Existing KBVQA methods either utilize implicit knowledge in multimodal large language mode…

Visual Question Answering

FoMoVLA: Bridging Visual Foresight and Motion Guidance for Vision-Language-Action Models

2026-07-16 · Wei Li, Peijin Jia, Yuan Ma, Xuefeng Jiang 외 arxiv

Vision-Language-Action (VLA) models have achieved impressive results in visuomotor policy learning, yet remain fundamentally reactive, mapping current observations and language to actions without explicit forward predict…

Zero-shot GeneralizationPoint Tracking