paper-with-me

홈 › Papers

Guided Discovery of New Behaviors using Diffusion Policies

2026-06-07 · Dian Yu, Sebastian Sanokowski, Majid Khadiv arxiv

Diffusion models have become a powerful tool for generative modeling in robotics, with diffusion policies excelling at modeling multimodal action-trajectory distributions. However, when demonstrations are limited, standard sampling often reproduces dominant behaviors while neglecting valid but rare modes, limiting the discovery of novel solutions. Existing approaches, such as guidance methods or combining reinforcement learning with diffusion, either push samples into infeasible regions or struggle to escape local minima, failing to systematically uncover diverse behaviors. To address these challenges, we propose a framework that combines Feynman-Kac correctors with a novel guiding potential that systematically guides diffusion policy samples towards promising yet underrepresented samples. These trajectories are refined using sampling-based trajectory optimization and reincorporated into the training set to retrain the diffusion policy. Our method effectively mines and repairs novel trajectories, enabling the systematic discovery of diverse and executable behaviors. We demonstrate the effectiveness of our framework across a range of manipulation environments, consistently discovering new behaviors.

📄 PDF Abstract BibTeX arXiv:2606.08743

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

PriGo: Test-Time Primitive Guidance to Diffusion and Flow Policies for Adaptive Robotic Manipulation

2026-07-08 · Zezeng Li, Enda Xiang, Thuy Tran, Di Huang 외 arxiv

Imitation learning has enabled remarkable progress in robotic manipulation, especially with diffusion and flow-based policies that generate complex visuomotor behaviors directly from demonstrations. Yet, despite their st…

Behavioral Mode Discovery for Fine-tuning Multimodal Generative Policies

2026-05-12 · Alberta Longhini, David Emukpere, Jean-Michel Renders, Seungsu Kim arxiv

We address the problem of fine-tuning pre-trained generative policies with reinforcement learning (RL) while preserving the multimodality of their action distributions. Existing methods for RL fine-tuning of generative p…

Reinforcement Learning

Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous and Instruction-guided Driving

2024-01-01 · CVPR 2024 1 · Brian Yang, Huangyuan Su, Nikolaos Gkanatsios, Tsung-Wei Ke 외

Diffusion models excel at modeling complex and multimodal trajectory distributions for decision-making and control. Reward-gradient guided denoising has been recently proposed to generate trajectories that maximize b…

Autonomous DrivingDenoisingEfficient Exploration

Online Feedback Efficient Active Target Discovery in Partially Observable Environments

2025-05-10 · Anindya Sarkar, Binglin Ji, Yevgeniy Vorobeychik

In various scientific and engineering domains, where data acquisition is costly, such as in medical imaging, environmental monitoring, or remote sensing, strategic sampling from unobserved regions, guided by prior observ…

Make-An-Agent: A Generalizable Policy Network Generator with Behavior-Prompted Diffusion

2024-07-15 · Yongyuan Liang, Tingqiang Xu, Kaizhe Hu, Guangqi Jiang 외

Can we generate a control policy for an agent using just one demonstration of desired behaviors as a prompt, as effortlessly as creating an image from a textual description? In this paper, we present Make-An-Agent, a nov…