paper-with-me

홈 › Papers

Eta Inversion: Designing an Optimal Eta Function for Diffusion-based Real Image Editing

2024-03-14 · Wonjun Kang, Kevin Galim, Hyung Il Koo

Diffusion models have achieved remarkable success in the domain of text-guided image generation and, more recently, in text-guided image editing. A commonly adopted strategy for editing real images involves inverting the diffusion process to obtain a noisy representation of the original image, which is then denoised to achieve the desired edits. However, current methods for diffusion inversion often struggle to produce edits that are both faithful to the specified text prompt and closely resemble the source image. To overcome these limitations, we introduce a novel and adaptable diffusion inversion technique for real image editing, which is grounded in a theoretical analysis of the role of $\eta$ in the DDIM sampling equation for enhanced editability. By designing a universal diffusion inversion method with a time- and region-dependent $\eta$ function, we enable flexible control over the editing extent. Through a comprehensive series of quantitative and qualitative assessments, involving a comparison with a broad array of recent methods, we demonstrate the superiority of our approach. Our method not only sets a new benchmark in the field but also significantly outperforms existing strategies.

📄 PDF Abstract BibTeX arXiv:2403.09468

Code (1)

furiosa-ai/eta-inversion 공식 구현 pytorch

Tasks

Image Generationtext-guided-image-editing

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Inversion-by-Inversion: Exemplar-based Sketch-to-Photo Synthesis via Stochastic Differential Equations without Training

2023-08-15 · XiMing Xing, Chuang Wang, Haitao Zhou, Zhihao Hu 외

Exemplar-based sketch-to-photo synthesis allows users to generate photo-realistic images based on sketches. Recently, diffusion-based methods have achieved impressive performance on image generation tasks, enabling highl…

Image Generation

Semantic Image Inversion and Editing using Rectified Stochastic Differential Equations

2024-10-14 · Litu Rout, Yujia Chen, Nataniel Ruiz, Constantine Caramanis 외

Generative models transform random noise into images; their inversion aims to transform images back to structured noise for recovery and editing. This paper addresses two key tasks: (i) inversion and (ii) editing of a re…

Image Generation

Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Code

2023-10-02 · Xuan Ju, Ailing Zeng, Yuxuan Bian, Shaoteng Liu 외

Text-guided diffusion models have revolutionized image generation and editing, offering exceptional realism and diversity. Specifically, in the context of diffusion-based editing, where a source image is edited according…

Image GenerationText-based Image Editing

Optimal Transport for Rectified Flow Image Editing: Unifying Inversion-Based and Direct Methods

2025-08-04 · Marian Lupascu, Mihai-Sorin Stupariu arxiv

Image editing in rectified flow models remains challenging due to the fundamental trade-off between reconstruction fidelity and editing flexibility. While inversion-based methods suffer from trajectory deviation, recent …

Image Editing

Latent Bias Alignment for High-Fidelity Diffusion Inversion in Real-World Image Reconstruction and Manipulation

2026-03-25 · Weiming Chen, Qifan Liu, Siyi Liu, Yushun Tang 외 arxiv

Recent research has shown that text-to-image diffusion models are capable of generating high-quality images guided by text prompts. But can they be used to generate or approximate real-world images from the seed noise? T…

Image ReconstructionImage Editing