paper-with-me

홈 › Papers

Factorized Diffusion Architectures for Unsupervised Image Generation and Segmentation

2023-09-27 · Xin Yuan, Michael Maire

We develop a neural network architecture which, trained in an unsupervised manner as a denoising diffusion model, simultaneously learns to both generate and segment images. Learning is driven entirely by the denoising diffusion objective, without any annotation or prior knowledge about regions during training. A computational bottleneck, built into the neural architecture, encourages the denoising network to partition an input into regions, denoise them in parallel, and combine the results. Our trained model generates both synthetic images and, by simple examination of its internal predicted partitions, a semantic segmentation of those images. Without any finetuning, we directly apply our unsupervised model to the downstream task of segmenting real images via noising and subsequently denoising them. Experiments demonstrate that our model achieves accurate unsupervised image segmentation and high-quality synthetic image generation across multiple datasets.

📄 PDF Abstract BibTeX arXiv:2309.15726

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingImage GenerationImage SegmentationSegmentationSemantic SegmentationUnsupervised Image Segmentation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Video Editing via Factorized Diffusion Distillation

2024-03-14 · Uriel Singer, Amit Zohar, Yuval Kirstain, Shelly Sheynin 외

We introduce Emu Video Edit (EVE), a model that establishes a new state-of-the art in video editing without relying on any supervised video editing data. To develop EVE we separately train an image editing adapter and a …

Video EditingVideo Generation

Breaking the Factorization Barrier in Diffusion Language Models

2026-02-09 · Ian Li, Zilei Shao, Benjie Wang, Rose Yu 외 arxiv

Diffusion language models theoretically allow for efficient parallel generation but are practically hindered by the "factorization barrier": the assumption that simultaneously predicted tokens are independent. This limit…

Reinforcement Learning

Unsupervised Decomposition and Recombination with Discriminator-Driven Diffusion Models

2026-01-29 · Archer Wang, Emile Anand, Yilun Du, Marin Soljačić arxiv

Decomposing complex data into factorized representations can reveal reusable components and enable synthesizing new samples via component recombination. We investigate this in the context of diffusion-based models that l…

Language-Guided Trajectory Traversal in Disentangled Stable Diffusion Latent Space for Factorized Medical Image Generation

2025-03-30 · Zahra Tehraninasab, Amar Kumar, Tal Arbel

Text-to-image diffusion models have demonstrated a remarkable ability to generate photorealistic images from natural language prompts. These high-resolution, language-guided synthesized images are essential for the expla…

DiagnosticDisentanglementImage GenerationMedical Image Generation

E-MoE: Enhanced Mixture-of-Experts for Non-Factorized Diffusion Language Models

2026-09-29 · Arseny Ivanov, Alexander Kolesov, Alexander Korotin, Ivan Oseledets 외 hf

Masked diffusion models (MDMs) generate sequences by progressively unmasking several tokens per denoising step, but their reverse process is typically factorized over positions, limiting sample quality in the few-step re…