paper-with-me

Papers

LayeringDiff: Layered Image Synthesis via Generation, then Disassembly with Generative Knowledge

2025-01-02 · Kyoungkook Kang, Gyujin Sim, Geonung Kim, Donguk Kim, Seungho Nam, Sunghyun Cho

Layers have become indispensable tools for professional artists, allowing them to build a hierarchical structure that enables independent control over individual visual elements. In this paper, we propose LayeringDiff, a novel pipeline for the synthesis of layered images, which begins by generating a composite image using an off-the-shelf image generative model, followed by disassembling the image into its constituent foreground and background layers. By extracting layers from a composite image, rather than generating them from scratch, LayeringDiff bypasses the need for large-scale training to develop generative capabilities for individual layers. Furthermore, by utilizing a pretrained off-the-shelf generative model, our method can produce diverse contents and object scales in synthesized layers. For effective layer decomposition, we adapt a large-scale pretrained generative prior to estimate foreground and background layers. We also propose high-frequency alignment modules to refine the fine-details of the estimated layers. Our comprehensive experiments demonstrate that our approach effectively synthesizes layered images and supports various practical applications.

📄 PDF Abstract BibTeX arXiv:2501.01197

Code (0)

등록된 구현이 없습니다.

Tasks

Image Generation

Similar Papers 제목 키워드 기반

BFS: Back-to-Front Layered Image Synthesis via Knowledge Transfer

2026-05-24 · Kyoungkook Kang, Gyujin Sim, Sunghyun Cho arxiv

As generative models expand the possibilities of visual content creation, layered image synthesis has emerged as a promising direction for controllable and creative editing. However, existing methods struggle to fully re…

LayerDiff: Exploring Text-guided Multi-layered Composable Image Synthesis via Layer-Collaborative Diffusion Model

2024-03-18 · Runhui Huang, Kaixin Cai, Jianhua Han, Xiaodan Liang 외

Despite the success of generating high-quality images given any text prompts by diffusion-based generative models, prior works directly generate the entire images, but cannot provide object-wise manipulation capability. …

Image GenerationStyle Transfer

GenLayNeRF: Generalizable Layered Representations with 3D Model Alignment for Multi-Human View Synthesis

2023-09-20 · Youssef Abdelkareem, Shady Shehata, Fakhri Karray

Novel view synthesis (NVS) of multi-human scenes imposes challenges due to the complex inter-human occlusions. Layered representations handle the complexities by dividing the scene into multi-layered radiance fields, how…

NeRFNovel View Synthesis

Layered Diffusion Model for One-Shot High Resolution Text-to-Image Synthesis

2024-07-08 · Emaad Khwaja, Abdullah Rashwan, Ting Chen, Oliver Wang 외

We present a one-shot text-to-image diffusion model that can generate high-resolution images from natural language descriptions. Our model employs a layered U-Net architecture that simultaneously synthesizes images at mu…

Image GenerationSuper-Resolution

MRT: Masked Region Transformer for Layered Image Generation and Editing at Scale

2026-05-26 · Zhicong Tang, Zhao Zhang, Jingye Chen, Mohan Zhou 외 arxiv

Layered image generation and editing is a fundamental capability that enables layer-wise reuse, editing, and composition of generated visual content, analogous to word-level editing in natural language. Despite its impor…

Image Generation