paper-with-me

Papers

Hierarchical Koopman Diffusion: Fast Generation with Interpretable Diffusion Trajectory

2025-10-14 · Hanru Bai, Weiyang Ding, Difan Zou arxiv

Diffusion models have achieved impressive success in high-fidelity image generation but suffer from slow sampling due to their inherently iterative denoising process. While recent one-step methods accelerate inference by learning direct noise-to-image mappings, they sacrifice the interpretability and fine-grained control intrinsic to diffusion dynamics, key advantages that enable applications like editable generation. To resolve this dichotomy, we introduce \textbf{Hierarchical Koopman Diffusion}, a novel framework that achieves both one-step sampling and interpretable generative trajectories. Grounded in Koopman operator theory, our method lifts the nonlinear diffusion dynamics into a latent space where evolution is governed by globally linear operators, enabling closed-form trajectory solutions. This formulation not only eliminates iterative sampling but also provides full access to intermediate states, allowing manual intervention during generation. To model the multi-scale nature of images, we design a hierarchical architecture that disentangles generative dynamics across spatial resolutions via scale-specific Koopman subspaces, capturing coarse-to-fine details systematically. We empirically show that the Hierarchical Koopman Diffusion not only achieves competitive one-step generation performance but also provides a principled mechanism for interpreting and manipulating the generative process through spectral analysis. Our framework bridges the gap between fast sampling and interpretability in diffusion models, paving the way for explainable image synthesis in generative modeling.

📄 PDF Abstract BibTeX arXiv:2510.12220

Code (0)

등록된 구현이 없습니다.

Tasks

Image Generation

Similar Papers 제목 키워드 기반

FlightKooba: A Fast Interpretable FTP Model

2025-06-24 · Jing Lu, Xuan Wu, Yizhun Tian, Songhan Fan 외

The Koopman theory is a powerful and effective modeling tool for converting nonlinear systems into linear representations, and flight trajectory prediction (FTP) is a complex nonlinear system. However, current models app…

MambamodelTime Series ForecastingTrajectory Prediction

One-Step Offline Distillation of Diffusion-based Models via Koopman Modeling

2025-05-19 · Nimrod Berman, Ilan Naiman, Moshe Eliasof, Hedi Zisling 외

Diffusion-based generative models have demonstrated exceptional performance, yet their iterative sampling procedures remain computationally expensive. A prominent strategy to mitigate this cost is distillation, with offl…

Semantic SimilaritySemantic Textual Similarity

Dynamic Neural Koopman Distillation for Real-Time Robot Control Using Diffusion Models

2026-05-24 · Lei Zheng, Peiqi Yu, Zengqi Peng, Changliu Liu 외 arxiv

Diffusion models excel at generating diverse and multimodal trajectories for robotic planning, yet their iterative denoising process introduces latency that is incompatible with high-frequency closed-loop control. To add…

Physics-Informed Neural Koopman Machine for Interpretable Longitudinal Personalized Alzheimer's Disease Forecasting

2025-12-05 · Georgi Hrusanov, Duy-Thanh Vu, Duy-Cat Can, Sophie Tascedda 외 arxiv

Early forecasting of individual cognitive decline in Alzheimer's disease (AD) is central to disease evaluation and management. Despite advances, it is as of yet challenging for existing methodological frameworks to integ…

Compression of the Koopman matrix for nonlinear physical models via hierarchical clustering

2024-03-27 · Tomoya Nishikata, Jun Ohkubo

Machine learning methods allow the prediction of nonlinear dynamical systems from data alone. The Koopman operator is one of them, which enables us to employ linear analysis for nonlinear dynamical systems. The linear ch…

Clustering