paper-with-me

Papers

LayerDiffusion: Layered Controlled Image Editing with Diffusion Models

2023-05-30 · Pengzhi Li, QInxuan Huang, Yikang Ding, Zhiheng Li

Text-guided image editing has recently experienced rapid development. However, simultaneously performing multiple editing actions on a single image, such as background replacement and specific subject attribute changes, while maintaining consistency between the subject and the background remains challenging. In this paper, we propose LayerDiffusion, a semantic-based layered controlled image editing method. Our method enables non-rigid editing and attribute modification of specific subjects while preserving their unique characteristics and seamlessly integrating them into new backgrounds. We leverage a large-scale text-to-image model and employ a layered controlled optimization strategy combined with layered diffusion training. During the diffusion process, an iterative guidance strategy is used to generate a final image that aligns with the textual description. Experimental results demonstrate the effectiveness of our method in generating highly coherent images that closely align with the given textual description. The edited images maintain a high similarity to the features of the input image and surpass the performance of current leading image editing methods. LayerDiffusion opens up new possibilities for controllable image editing.

📄 PDF Abstract BibTeX arXiv:2305.18676

Code (0)

등록된 구현이 없습니다.

Tasks

Attributetext-guided-image-editing

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Streamlining Image Editing with Layered Diffusion Brushes

2024-05-01 · Peyman Gholami, Robert Xiao

Denoising diffusion models have recently gained prominence as powerful tools for a variety of image generation and manipulation tasks. Building on this, we propose a novel tool for real-time editing of images that provid…

AttributeDenoisingGPUImage Generation

OmniPSD: Layered PSD Generation with Diffusion Transformer

2025-12-10 · Cheng Liu, Yiren Song, Haofan Wang, Mike Zheng Shou arxiv

Recent advances in diffusion models have greatly improved image generation and editing, yet generating or reconstructing layered PSD files with transparent alpha channels remains highly challenging. We propose OmniPSD, a…

Image Generation

Text2Layer: Layered Image Generation using Latent Diffusion Model

2023-07-19 · Xinyang Zhang, Wentian Zhao, Xin Lu, Jeff Chien

Layer compositing is one of the most popular image editing workflows among both amateurs and professionals. Motivated by the success of diffusion models, we explore layer compositing from a layered image generation persp…

Image GenerationImage SegmentationmodelSemantic Segmentation

Move Anything with Layered Scene Diffusion

2024-04-10 · CVPR 2024 1 · Jiawei Ren, Mengmeng Xu, Jui-Chieh Wu, Ziwei Liu 외

Diffusion models generate images with an unprecedented level of quality, but how can we freely rearrange image layouts? Recent works generate controllable scenes via learning spatially disentangled latent codes, but thes…

DenoisingDisentanglement

MRT: Masked Region Transformer for Layered Image Generation and Editing at Scale

2026-05-26 · Zhicong Tang, Zhao Zhang, Jingye Chen, Mohan Zhou 외 arxiv

Layered image generation and editing is a fundamental capability that enables layer-wise reuse, editing, and composition of generated visual content, analogous to word-level editing in natural language. Despite its impor…

Image Generation