paper-with-me

Papers

Tree-Guided Diffusion Planner

2025-08-29 · Hyeonseong Jeon, Cheolhong Min, Jaesik Park arxiv

Planning with pretrained diffusion models has emerged as a promising approach for solving test-time guided control problems. Standard gradient guidance typically performs optimally under convex, differentiable reward landscapes. However, it shows substantially reduced effectiveness in real-world scenarios with non-convex objectives, non-differentiable constraints, and multi-reward structures. Furthermore, recent supervised planning approaches require task-specific training or value estimators, which limits test-time flexibility and zero-shot generalization. We propose a Tree-guided Diffusion Planner (TDP), a zero-shot test-time planning framework that balances exploration and exploitation through structured trajectory generation. We frame test-time planning as a tree search problem using a bi-level sampling process: (1) diverse parent trajectories are produced via training-free particle guidance to encourage broad exploration, and (2) sub-trajectories are refined through fast conditional denoising guided by task objectives. TDP addresses the limitations of gradient guidance by exploring diverse trajectory regions and harnessing gradient information across this expanded solution space using only pretrained models and test-time reward signals. We evaluate TDP on three diverse tasks: maze gold-picking, robot arm block manipulation, and AntMaze multi-goal exploration. TDP consistently outperforms state-of-the-art approaches on all tasks. The project page can be found at: https://tree-diffusion-planner.github.io.

📄 PDF Abstract BibTeX arXiv:2508.21800

Code (0)

등록된 구현이 없습니다.

Tasks

Zero-shot Generalization

Similar Papers 제목 키워드 기반

Resisting Stochastic Risks in Diffusion Planners with the Trajectory Aggregation Tree

2024-05-28 · Lang Feng, Pengjie Gu, Bo An, Gang Pan

Diffusion planners have shown promise in handling long-horizon and sparse-reward tasks due to the non-autoregressive plan generation. However, their inherent stochastic risk of generating infeasible trajectories presents…

Decision Making

Task-agnostic Pre-training and Task-guided Fine-tuning for Versatile Diffusion Planner

2024-09-30 · Chenyou Fan, Chenjia Bai, Zhao Shan, Haoran He 외

Diffusion models have demonstrated their capabilities in modeling trajectories of multi-tasks. However, existing multi-task planners or policies typically rely on task-specific demonstrations via multi-task imitation, or…

Reinforcement Learning (RL)

Monte Carlo Tree Diffusion with Multiple Experts for Protein Design

2025-09-19 · Xuefeng Liu, Mingxuan Cao, Songhao Jiang, Xiao Luo 외 arxiv

The goal of protein design is to generate amino acid sequences that fold into functional structures with desired properties. Prior methods combining autoregressive language models with Monte Carlo Tree Search (MCTS) stru…

Protein Design

Prior-Guided Diffusion Planning for Offline Reinforcement Learning

2025-05-16 · Donghyeon Ki, JunHyeok Oh, Seong-Woong Shim, Byung-Jun Lee

Diffusion models have recently gained prominence in offline reinforcement learning due to their ability to effectively learn high-performing, generalizable policies from static datasets. Diffusion-based planners facilita…

Decision MakingDenoisingOffline RLreinforcement-learning+1

Monte Carlo Tree Diffusion for System 2 Planning

2025-02-11 · Jaesik Yoon, Hyeonseo Cho, Doojin Baek, Yoshua Bengio 외

Diffusion models have recently emerged as a powerful tool for planning. However, unlike Monte Carlo Tree Search (MCTS)-whose performance naturally improves with additional test-time computation (TTC), standard diffusion-…

Denoising