paper-with-me

Papers

Composing Diffusion Policies for Few-shot Learning of Movement Trajectories

2024-10-22 · Omkar Patil, Anant Sah, Nakul Gopalan

Humans can perform various combinations of physical skills without having to relearn skills from scratch every single time. For example, we can swing a bat when walking without having to re-learn such a policy from scratch by composing the individual skills of walking and bat swinging. Enabling robots to combine or compose skills is essential so they can learn novel skills and tasks faster with fewer real world samples. To this end, we propose a novel compositional approach called DSE- Diffusion Score Equilibrium that enables few-shot learning for novel skills by utilizing a combination of base policy priors. Our method is based on probabilistically composing diffusion policies to better model the few-shot demonstration data-distribution than any individual policy. Our goal here is to learn robot motions few-shot and not necessarily goal oriented trajectories. Unfortunately we lack a general purpose metric to evaluate the error between a skill or motion and the provided demonstrations. Hence, we propose a probabilistic measure - Maximum Mean Discrepancy on the Forward Kinematics Kernel (MMD-FK), that is task and action space agnostic. By using our few-shot learning approach DSE, we show that we are able to achieve a reduction of over 30% in MMD-FK across skills and number of demonstrations. Moreover, we show the utility of our approach through real world experiments by teaching novel trajectories to a robot in 5 demonstrations.

📄 PDF Abstract BibTeX arXiv:2410.17479

Code (0)

등록된 구현이 없습니다.

Tasks

Few-Shot Learning

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
BASE 설명 없음

Similar Papers 제목 키워드 기반

FODMP: Fast One-Step Diffusion of Movement Primitives Generation for Time-Dependent Robot Actions

2026-03-25 · Xirui Shi, Arya Ebrahimi, Yi Hu, Jun Jin arxiv

Diffusion models are increasingly used for robot learning, but current designs face a clear trade-off. Action-chunking diffusion policies like ManiCM are fast to run, yet they only predict short segments of motion. This …

BayesFP: Posterior Estimation for Flow-Based Policies via Feynman-Kac Sampling

2026-06-19 · Sreevardhan Sirigiri, Weiming Zhi, Fabio Ramos arxiv

Robots must generate trajectories that remain faithful to learned expert behavior while satisfying safety constraints and task-specific objectives specified only at inference time. We formulate constrained trajectory gen…

Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Following

2024-02-09 · Brian Yang, Huangyuan Su, Nikolaos Gkanatsios, Tsung-Wei Ke 외

Diffusion models excel at modeling complex and multimodal trajectory distributions for decision-making and control. Reward-gradient guided denoising has been recently proposed to generate trajectories that maximize both …

Autonomous DrivingDenoisingEfficient ExplorationInstruction Following

Beyond Imitation: Reinforcement Learning Fine-Tuning for Adaptive Diffusion Navigation Policies

2026-03-13 · Junhe Sheng, Ruofei Bai, Kuan Xu, Ruimeng Liu 외 arxiv

Diffusion-based robot navigation policies trained on large-scale imitation learning datasets, can generate multi-modal trajectories directly from the robot's visual observations, bypassing the traditional localization-ma…

Zero-shot GeneralizationReinforcement LearningRobot Navigation

Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous and Instruction-guided Driving

2024-01-01 · CVPR 2024 1 · Brian Yang, Huangyuan Su, Nikolaos Gkanatsios, Tsung-Wei Ke 외

Diffusion models excel at modeling complex and multimodal trajectory distributions for decision-making and control. Reward-gradient guided denoising has been recently proposed to generate trajectories that maximize b…

Autonomous DrivingDenoisingEfficient Exploration