paper-with-me

Papers

DiffDecompose: Layer-Wise Decomposition of Alpha-Composited Images via Diffusion Transformers

2025-05-24 · Zitong Wang, Hang Zhao, Qianyu Zhou, Xuequan Lu, Xiangtai Li, Yiren Song

Diffusion models have recently motivated great success in many generation tasks like object removal. Nevertheless, existing image decomposition methods struggle to disentangle semi-transparent or transparent layer occlusions due to mask prior dependencies, static object assumptions, and the lack of datasets. In this paper, we delve into a novel task: Layer-Wise Decomposition of Alpha-Composited Images, aiming to recover constituent layers from single overlapped images under the condition of semi-transparent/transparent alpha layer non-linear occlusion. To address challenges in layer ambiguity, generalization, and data scarcity, we first introduce AlphaBlend, the first large-scale and high-quality dataset for transparent and semi-transparent layer decomposition, supporting six real-world subtasks (e.g., translucent flare removal, semi-transparent cell decomposition, glassware decomposition). Building on this dataset, we present DiffDecompose, a diffusion Transformer-based framework that learns the posterior over possible layer decompositions conditioned on the input image, semantic prompts, and blending type. Rather than regressing alpha mattes directly, DiffDecompose performs In-Context Decomposition, enabling the model to predict one or multiple layers without per-layer supervision, and introduces Layer Position Encoding Cloning to maintain pixel-level correspondence across layers. Extensive experiments on the proposed AlphaBlend dataset and public LOGO dataset verify the effectiveness of DiffDecompose. The code and dataset will be available upon paper acceptance. Our code will be available at: https://github.com/Wangzt1121/DiffDecompose.

📄 PDF Abstract BibTeX arXiv:2505.21541

Code (0)

등록된 구현이 없습니다.

Tasks

Flare Removal

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

LayerD: Decomposing Raster Graphic Designs into Layers

2025-09-29 · Tomoyuki Suzuki, Kang-Jun Liu, Naoto Inoue, Kota Yamaguchi arxiv

Designers craft and edit graphic designs in a layer representation, but layer-based editing becomes impossible once composited into a raster image. In this work, we propose LayerD, a method to decompose raster graphic de…

LayerT2V: A Unified Multi-Layer Video Generation Framework

2025-08-06 · Guangzhao Li, Kangrui Cen, Baixuan Zhao, Yi Xin 외 arxiv

Text-to-video generation has advanced rapidly, but existing methods typically output only the final composited video and lack editable layered representations, limiting their use in professional workflows. We propose \te…

Text-to-Video Generation

AlphaAdam:Asynchronous Masked Optimization with Dynamic Alpha for Selective Updates

2025-01-30 · Da Chang, Yu Li, Ganzhao Yuan

In the training of large language models (LLMs), updating parameters more efficiently and stably has always been an important challenge. To achieve efficient parameter updates, existing methods usually achieve performanc…

Computational Efficiency

OmniAlpha: Aligning Transparency-Aware Generation via Multi-Task Unified Reinforcement Learning

2025-11-25 · Hao Yu, Jinglin Wang, Jiabo Zhan, Rui Chen 외 arxiv

Transparency-aware generation requires modeling not only RGB appearance but also alpha-based opacity and cross-layer composition, which are essential for tasks such as image matting, object removal, layer decomposition, …

Reinforcement LearningImage Matting

AlphaGAN: Generative adversarial networks for natural image matting

2018-07-26 · Sebastian Lutz, Konstantinos Amplianitis, Aljosa Smolic

We present the first generative adversarial network (GAN) for natural image matting. Our novel generator network is trained to predict visually appealing alphas with the addition of the adversarial loss from the discrimi…

DecoderGenerative Adversarial NetworkImage Matting