paper-with-me

Papers

Variational Test-time Optimization for Diffusion Synchronization

2026-06-14 · Hyunsoo Lee, Farrin Marouf Sofian, Kushagra Pandey, Stephan Mandt arxiv

Collaborative generation, which coordinates multiple diffusion trajectories to extend the capabilities of pretrained priors, has emerged as a powerful paradigm for extending the applicability of diffusion models. Among existing approaches, diffusion synchronization provides a scenario-agnostic solution by introducing general guidance mechanisms. However, current synchronization approaches rely heavily on heuristics and still require task-specific tailoring, which limits their generalizability and performance. In this work, we mathematically derive a synchronization framework based on optimal control, providing a principled explanation of diffusion synchronization. During sampling, we optimize control variables to guide multiple trajectories toward coherent solutions while remaining close to the underlying diffusion prior. Our method operates entirely at test-time without additional training, thereby enabling broad applicability across diverse generation scenarios when combined with strong pretrained priors. We demonstrate consistent improvements over baselines on three representative collaborative generation tasks, covering a wide range of modalities and applications. Beyond performance gains, our work establishes a novel foundation for collaborative generation, opening a principled path toward extending pretrained generative models to new collaborative generation settings.

📄 PDF Abstract BibTeX arXiv:2606.15614

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Hierarchical Variational Policies for Reward-Guided Diffusion

2026-05-20 · Kushagra Pandey, Farrin Marouf Sofian, Jan Niklas Groeneveld, Felix Draxler 외 arxiv

Adapting pretrained diffusion models to downstream objectives such as inverse problems often requires expensive test-time guidance or optimization. We propose a principled framework for generating high-quality reward-ali…

Test-time Adaptation

Lip Forcing: Few-Step Autoregressive Diffusion for Real-time Lip Synchronization

2026-06-09 · Paul Hyunbin Cho, Jinhyuk Jang, SeokYoung Lee, Joungbin Lee 외 arxiv

Diffusion-based lip synchronization models achieve strong visual quality and audio-visual alignment, but full-sequence bidirectional attention and many denoising steps make them impractical for real-time inference. We pr…

Diffusion Alignment as Variational Expectation-Maximization

2025-10-01 · Jaewoo Lee, Minsu Kim, Sanghyeok Choi, Inhyuck Song 외 arxiv

Diffusion alignment aims to optimize diffusion models for the downstream objective. While existing methods based on reinforcement learning or direct backpropagation achieve considerable success in maximizing rewards, the…

Reinforcement Learning

Fast and Robust Likelihood-Guided Diffusion Posterior Sampling with Amortized Variational Inference

2026-02-06 · Léon Zheng, Thomas Hirtz, Yazid Janati, Eric Moulines arxiv

Zero-shot diffusion posterior sampling offers a flexible framework for inverse problems by accommodating arbitrary degradation operators at test time, but incurs high computational cost due to repeated likelihood-guided …

Performance Optimization on Model Synchronization in Parallel Stochastic Gradient Descent Based SVM

2019-05-03 · Vibhatha Abeykoon, Geoffrey Fox, Minje Kim

Understanding the bottlenecks in implementing stochastic gradient descent (SGD)-based distributed support vector machines (SVM) algorithm is important in training larger data sets. The communication time to do the model …

Model Optimization