paper-with-me

홈 › Papers

MDE-Edit: Masked Dual-Editing for Multi-Object Image Editing via Diffusion Models

2025-05-08 · Hongyang Zhu, Haipeng Liu, Bo Fu, Yang Wang

Multi-object editing aims to modify multiple objects or regions in complex scenes while preserving structural coherence. This task faces significant challenges in scenarios involving overlapping or interacting objects: (1) Inaccurate localization of target objects due to attention misalignment, leading to incomplete or misplaced edits; (2) Attribute-object mismatch, where color or texture changes fail to align with intended regions due to cross-attention leakage, creating semantic conflicts (\textit{e.g.}, color bleeding into non-target areas). Existing methods struggle with these challenges: approaches relying on global cross-attention mechanisms suffer from attention dilution and spatial interference between objects, while mask-based methods fail to bind attributes to geometrically accurate regions due to feature entanglement in multi-object scenarios. To address these limitations, we propose a training-free, inference-stage optimization approach that enables precise localized image manipulation in complex multi-object scenes, named MDE-Edit. MDE-Edit optimizes the noise latent feature in diffusion models via two key losses: Object Alignment Loss (OAL) aligns multi-layer cross-attention with segmentation masks for precise object positioning, and Color Consistency Loss (CCL) amplifies target attribute attention within masks while suppressing leakage to adjacent regions. This dual-loss design ensures localized and coherent multi-object edits. Extensive experiments demonstrate that MDE-Edit outperforms state-of-the-art methods in editing accuracy and visual quality, offering a robust solution for complex multi-object image manipulation tasks.

📄 PDF Abstract BibTeX arXiv:2505.05101

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeImage ManipulationObject

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

ExpertEdit: Learning Skill-Aware Motion Editing from Expert Videos

2026-04-12 · Arjun Somayazulu, Kristen Grauman arxiv

Visual feedback is critical for motor skill acquisition in sports and rehabilitation, and psychological studies show that observing near-perfect versions of one's own performance accelerates learning more effectively tha…

Edit as You See: Image-guided Video Editing via Masked Motion Modeling

2025-01-08 · Zhi-Lin Huang, Yixuan Liu, Chujun Qin, Zhongdao Wang 외

Recent advancements in diffusion models have significantly facilitated text-guided video editing. However, there is a relative scarcity of research on image-guided video editing, a method that empowers users to edit vide…

Optical Flow EstimationSelf-Supervised LearningVideo Editing

ReSpace: Text-Driven 3D Scene Synthesis and Editing with Preference Alignment

2025-06-03 · Martin JJ. Bucher, Iro Armeni

Scene synthesis and editing has emerged as a promising direction in computer graphics. Current trained approaches for 3D indoor scenes either oversimplify object semantics through one-hot class encodings (e.g., 'chair' o…

Indoor Scene SynthesisObjectSpatial Reasoning

DICE: Discrete Inversion Enabling Controllable Editing for Multinomial Diffusion and Masked Generative Models

2024-10-10 · Xiaoxiao He, Ligong Han, Quan Dao, Song Wen 외

Discrete diffusion models have achieved success in tasks like image generation and masked language modeling but face limitations in controlled content editing. We introduce DICE (Discrete Inversion for Controllable Editi…

Image GenerationLanguage ModelingLanguage ModellingMasked Language Modeling

Masked Generative Transformer Is What You Need for Image Editing

2026-05-11 · Wei Chow, Linfeng Li, Xian Sun, Lingdong Kong 외 arxiv

Diffusion models dominate image editing, yet their global denoising mechanism entangles edited regions with surrounding context, causing modifications to propagate into areas that should remain intact. We propose a funda…

Image Editing