paper-with-me

Papers

Compositional Visual Planning via Inference-Time Diffusion Scaling

2026-03-03 · Yixin Zhang, Yunhao Luo, Utkarsh Aashu Mishra, Woo Chul Shin, Yongxin Chen, Danfei Xu arxiv

Diffusion models excel at short-horizon robot planning, yet scaling them to long-horizon tasks remains challenging due to computational constraints and limited training data. Existing compositional approaches stitch together short segments by separately denoising each component and averaging overlapping regions. However, this suffers from instability as the factorization assumption breaks down in noisy data space, leading to inconsistent global plans. We propose that the key to stable compositional generation lies in enforcing boundary agreement on the estimated clean data (Tweedie estimates) rather than on noisy intermediate states. Our method formulates long-horizon planning as inference over a chain-structured factor graph of overlapping video chunks, where pretrained short-horizon video diffusion models provide local priors. At inference time, we enforce boundary agreement through a novel combination of synchronous and asynchronous message passing that operates on Tweedie estimates, producing globally consistent guidance without requiring additional training. Our training-free framework demonstrates significant improvements over existing baselines, effectively generalizing to unseen start-goal combinations that were not present in the original training data. Project website: https://comp-visual-planning.github.io/

📄 PDF Abstract BibTeX arXiv:2603.02646

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

MADI: Masking-Augmented Diffusion with Inference-Time Scaling for Visual Editing

2025-07-16 · Shreya Kadambi, Risheek Garrepalli, Shubhankar Borse, Munawar Hyatt 외 arxiv

Despite the remarkable success of diffusion models in text-to-image generation, their effectiveness in grounded visual editing and compositional control remains challenging. Motivated by advances in self-supervised learn…

Self-Supervised LearningText-to-Image Generation

Energy-based Compositional Diffusion Planning

2026-06-19 · Tao Sun, Utkarsh Aashu Mishra, Jiaxin Lu, Danfei Xu 외 arxiv

Compositional diffusion planners aim to solve long-horizon robotic tasks using short training trajectories. Yet, current approaches often rely on the heuristic stitching of local predictions. We show that the resulting s…

Compositional Monte Carlo Tree Diffusion for Extendable Planning

2025-10-24 · Jaesik Yoon, Hyeonseo Cho, Sungjin Ahn arxiv

Monte Carlo Tree Diffusion (MCTD) integrates diffusion models with structured tree search to enable effective trajectory exploration through stepwise reasoning. However, MCTD remains fundamentally limited by training tra…

Coarse-to-Fine Compositional Diffusion for Long-Horizon Planning

2026-05-30 · Byoungwoo Park, Utkarsh A. Mishra, Jaemoo Choi, Juho Lee 외 arxiv

Diffusion models provide strong priors for generating structured data, but many tasks require outputs beyond the scale on which these models are typically trained. Compositional generation addresses this by composing ove…

Video GenerationImage Generation

LayoutAgent: A Vision-Language Agent Guided Compositional Diffusion for Spatial Layout Planning

2025-09-24 · Zezhong Fan, Xiaohan Li, Luyi Ma, Kai Zhao 외 arxiv

Designing realistic multi-object scenes requires not only generating images, but also planning spatial layouts that respect semantic relations and physical plausibility. On one hand, while recent advances in diffusion mo…

Spatial ReasoningImage Generation