paper-with-me

Papers

LayerFusion: Harmonized Multi-Layer Text-to-Image Generation with Generative Priors

2024-12-05 · Yusuf Dalva, Yijun Li, Qing Liu, Nanxuan Zhao, Jianming Zhang, Zhe Lin, Pinar Yanardag

Large-scale diffusion models have achieved remarkable success in generating high-quality images from textual descriptions, gaining popularity across various applications. However, the generation of layered content, such as transparent images with foreground and background layers, remains an under-explored area. Layered content generation is crucial for creative workflows in fields like graphic design, animation, and digital art, where layer-based approaches are fundamental for flexible editing and composition. In this paper, we propose a novel image generation pipeline based on Latent Diffusion Models (LDMs) that generates images with two layers: a foreground layer (RGBA) with transparency information and a background layer (RGB). Unlike existing methods that generate these layers sequentially, our approach introduces a harmonized generation mechanism that enables dynamic interactions between the layers for more coherent outputs. We demonstrate the effectiveness of our method through extensive qualitative and quantitative experiments, showing significant improvements in visual coherence, image quality, and layer consistency compared to baseline methods.

📄 PDF Abstract BibTeX arXiv:2412.04460

Code (0)

등록된 구현이 없습니다.

Tasks

Image GenerationText to Image GenerationText-to-Image Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

PSDiffusion: Harmonized Multi-Layer Image Generation via Layout and Appearance Alignment

2025-05-16 · Dingbang Huang, Wenbo Li, Yifei Zhao, Xinyu Pan 외

Diffusion models have made remarkable advancements in generating high-quality images from textual descriptions. Recent works like LayerDiffuse have extended the previous single-layer, unified image generation paradigm to…

Image GenerationText to Image GenerationText-to-Image Generation

CHAIN: Concept-harmonized Hierarchical Inference Interpretation of Deep Convolutional Neural Networks

2020-02-05 · Dan Wang, Xinrui Cui, Z. Jane Wang

With the great success of networks, it witnesses the increasing demand for the interpretation of the internal network mechanism, especially for the net decision-making logic. To tackle the challenge, the Concept-harmoniz…

Decision Making

Collage Diffusion

2023-03-01 · Vishnu Sarukkai, Linden Li, Arden Ma, Christopher Ré 외

We seek to give users precise control over diffusion-based image generation by modeling complex scenes as sequences of layers, which define the desired spatial arrangement and visual attributes of objects in the scene. C…

Conditional Image GenerationImage GenerationImage Harmonization

Multi-View Harmonized Bilinear Network for 3D Object Recognition

2018-06-01 · CVPR 2018 6 · Tan Yu, Jingjing Meng, Junsong Yuan

View-based methods have achieved considerable success in $3$D object recognition tasks. Different from existing view-based methods pooling the view-wise features, we tackle this problem from the perspective of patches-t…

3D Object RecognitionObjectObject Recognition

Learning Harmonized Representations for Speculative Sampling

2024-08-28 · Lefan Zhang, Xiaodan Wang, Yanhua Huang, Ruiwen Xu

Speculative sampling is a promising approach to accelerate the decoding stage for Large Language Models (LLMs). Recent advancements that leverage target LLM's contextual information, such as hidden states and KV cache, h…