paper-with-me

홈 › Papers

Probing the Geometry of Diffusion Models with the String Method

2026-02-25 · Elio Moreau, Florentin Coeurdoux, Grégoire Ferre, Eric Vanden-Eijnden arxiv

Understanding the geometry of learned distributions is fundamental to improving and interpreting diffusion models, yet systematic tools for exploring their landscape remain limited. Standard latent-space interpolations fail to respect the structure of the learned distribution, often traversing low-density regions. We introduce a framework based on the string method that computes continuous paths between samples by evolving curves under the learned score function. Operating on pretrained models without retraining, our approach interpolates between three regimes: pure generative transport, which yields continuous sample paths; gradient-dominated dynamics, which recover minimum energy paths (MEPs); and finite-temperature string dynamics, which compute principal curves -- self-consistent paths that balance energy and entropy. We demonstrate that the choice of regime matters in practice. For image diffusion models, MEPs contain high-likelihood but unrealistic ''cartoon'' images, confirming prior observations that likelihood maxima appear unrealistic; principal curves instead yield realistic morphing sequences despite lower likelihood. For protein structure prediction, our method computes transition pathways between metastable conformers directly from models trained on static structures, yielding paths with physically plausible intermediates. Together, these results establish the string method as a principled tool for probing the modal structure of diffusion models -- identifying modes, characterizing barriers, and mapping connectivity in complex learned distributions.

📄 PDF Abstract BibTeX arXiv:2602.22122

Code (0)

등록된 구현이 없습니다.

Tasks

Protein Structure Prediction

Similar Papers 제목 키워드 기반

Characterizing 4-string contact interaction using machine learning

2022-11-16 · Harold Erbin, Atakan Hilmi Fırat

The geometry of 4-string contact interaction of closed string field theory is characterized using machine learning. We obtain Strebel quadratic differentials on 4-punctured spheres as a neural network by performing unsup…

Diffusion Model Attribution via Spectral Coupling of Denoiser Responses

2026-06-26 · Pragati Shuddhodhan Meshram, Varun Chandrasekaran arxiv

Attributing a generated image to its source diffusion model is a fundamental challenge in provenance verification and intellectual property protection. This problem is particularly difficult because diffusion models trai…

Draw Step by Step: Reconstructing CAD Construction Sequences from Point Clouds via Multimodal Diffusion.

2024-01-01 · CVPR 2024 1 · Weijian Ma, Shuaiqi Chen, Yunzhong Lou, Xueyang Li 외

Reconstructing CAD construction sequences from raw 3D geometry serves as an interface between real-world objects and digital designs. In this paper we propose CAD-Diffuser a multimodal diffusion scheme aiming at inte…

3D geometryCAD Reconstruction

Freeze, Diffuse, Decode: Geometry-Aware Adaptation of Pretrained Transformer Embeddings for Antimicrobial Peptide Design

2025-11-28 · Pankhil Gawade, Adam Izdebski, Myriam Lizotte, Kevin R. Moon 외 arxiv

Pretrained transformers provide rich, general-purpose embeddings, which are transferred to downstream tasks. However, current transfer strategies: fine-tuning and probing, either distort the pretrained geometric structur…

Extracting Training Data from Diffusion Language Models via Infilling

2026-05-22 · Yihan Wang, N. Asokan arxiv

Memorization in large language models has been studied almost exclusively through prefix-conditioned extraction, a natural choice for autoregressive models. However, diffusion language models (DLMs) can denoise masked to…