paper-with-me

홈 › Papers

Lipschitz-Guided Design of Interpolation Schedules in Generative Models

2025-09-01 · Yifan Chen, Eric Vanden-Eijnden, Jiawei Xu arxiv

We study the design of interpolation schedules in flow and diffusion-based generative models from both statistical and numerical perspectives. Within the stochastic interpolants framework, we first show that scalar interpolation schedules are statistically equivalent under the Kullback--Leibler divergence in path space, after optimal a posteriori tuning of the diffusion coefficient. This equivalence motivates focusing on numerical properties of the drift field rather than purely statistical criteria. We propose minimizing the averaged squared Lipschitzness of the drift as a principled criterion for schedule design, in contrast with kinetic-energy minimization in optimal transport. A simple transfer formula expresses the drift of one schedule in terms of the drift of another, allowing the designed schedule to be used at inference time with a model trained under a different (e.g., linear) schedule, without retraining. We work out the optimal schedules analytically for Gaussian and Gaussian-mixture targets: for Gaussians, we obtain exponential improvements in the Lipschitz constant over linear schedules; for Gaussian mixtures, we obtain schedules that mitigate mode collapse in few-step sampling. We then validate the approach on high-dimensional invariant measures of stochastic Allen--Cahn and Navier--Stokes equations, where the designed schedule yields markedly more accurate fine-scale statistics at fixed integrator budget.

📄 PDF Abstract BibTeX arXiv:2509.01629

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Scale-Adaptive Generative Flows for Multiscale Scientific Data

2025-09-03 · Yifan Chen, Eric Vanden-Eijnden arxiv

Flow-based generative models can face numerical challenges on scientific data with multiscale Fourier spectra, often producing large errors at fine scales. We approach this problem within the flow matching and stochastic…

Adversarial robustness through Lipschitz-Guided Stochastic Depth in Neural Networks

2025-09-12 · Laith Nayal, Mahmoud Mousatat, Bader Rasheed arxiv

Deep neural networks and Vision Transformers achieve state-of-the-art performance in computer vision but are highly vulnerable to adversarial perturbations. Standard defenses often incur high computational cost or lack f…

Adversarial Robustness

Spectrally-Guided Diffusion Noise Schedules

2026-03-19 · Carlos Esteves, Ameesh Makadia arxiv

Denoising diffusion models are widely used for high-quality image and video generation. Their performance depends on noise schedules, which define the distribution of noise levels applied during training and the sequence…

Video Generation

Gaussian Interpolation Flows

2023-11-20 · Yuan Gao, Jian Huang, Yuling Jiao

Gaussian denoising has emerged as a powerful method for constructing simulation-free continuous normalizing flows for generative modeling. Despite their empirical successes, theoretical properties of these flows and the …

Denoising

Select without Fear: Almost All Mini-Batch Schedules Generalize Optimally

2023-05-03 · Konstantinos E. Nikolakakis, Amin Karbasi, Dionysis Kalogerias

We establish matching upper and lower generalization error bounds for mini-batch Gradient Descent (GD) training with either deterministic or stochastic, data-independent, but otherwise arbitrary batch selection rules. We…

All