paper-with-me

Papers

Sharpen Your Flow: Sharpness-Aware Sampling for Flow Matching

2026-05-12 · Aditi Gupta, Soon Hoe Lim, Annan Yu, N. Benjamin Erichson arxiv

Flow matching models generate samples by numerically integrating a learned velocity field, with each integration step requiring a neural network evaluation. Fast generation therefore requires using a small fixed evaluation budget effectively: the key question is not only how to integrate the flow, but where the sampler should spend its steps. We propose SharpEuler, a training-free sampler that profiles a pretrained model offline by estimating where the learned velocity field changes most rapidly along calibration trajectories. This finite-difference estimate defines a solver-aware sharpness profile, which is smoothed and converted by a quantile transform into a timestep grid for any desired inference budget. At test time, sampling remains ordinary Euler integration with the same number of model evaluations as a uniform schedule. We justify SharpEuler using three principles: a numerical principle identifying trajectory acceleration as the leading source of Euler discretization error, a variational principle deriving sharpness-based power-law timestep densities, and a statistical guarantee showing that the finite-sample calibrated sampler is stable at the terminal distribution level. Our experiments show that SharpEuler improves sample quality at fixed budgets, reducing inter-mode leakage and increasing mode coverage.

📄 PDF Abstract BibTeX arXiv:2605.11547

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Subjective Study on a New Sharpness Informed Class of Metrics

2026-08-14 · Uditangshu Aurangabadkar, Vibhoothi Vibhoothi, Darren Ramsook, Anil Kokaram arxiv

Perceptual loss functions in Deep Neural Network (DNN) deblurring architectures improve the overall quality of restored images. However, few focus on explicitly targeting sharpness in the restorations. We conduct a subje…

Image Quality Assessment

A Minimalist Example of Edge-of-Stability and Progressive Sharpening

2025-03-04 · LiMing Liu, Zixuan Zhang, Simon Du, Tuo Zhao

Recent advances in deep learning optimization have unveiled two intriguing phenomena under large learning rates: Edge of Stability (EoS) and Progressive Sharpening (PS), challenging classical Gradient Descent (GD) analys…

Analyzing Sharpness along GD Trajectory: Progressive Sharpening and Edge of Stability

2022-07-26 · Zhouzi Li, Zixuan Wang, Jian Li

Recent findings (e.g., arXiv:2103.00065) demonstrate that modern neural networks trained by full-batch gradient descent typically enter a regime called Edge of Stability (EOS). In this regime, the sharpness, i.e., the ma…

Universal Sharpness Dynamics in Neural Network Training: Fixed Point Analysis, Edge of Stability, and Route to Chaos

2023-11-03 · Dayal Singh Kalra, Tianyu He, Maissam Barkeshli

In gradient descent dynamics of neural networks, the top eigenvalue of the loss Hessian (sharpness) displays a variety of robust phenomena throughout training. This includes early time regimes where the sharpness may dec…

LSAM: Asynchronous Distributed Training with Landscape-Smoothed Sharpness-Aware Minimization

2025-09-03 · Yunfei Teng, Sixin Zhang arxiv

While Sharpness-Aware Minimization (SAM) improves generalization in deep neural networks by minimizing both loss and sharpness, it suffers from inefficiency in distributed large-batch training. We present Landscape-Smoot…