paper-with-me

홈 › Papers

Spatial Diffusion for Cell Layout Generation

2024-09-04 · Chen Li, Xiaoling Hu, Shahira Abousamra, Meilong Xu, Chao Chen

Generative models, such as GANs and diffusion models, have been used to augment training sets and boost performances in different tasks. We focus on generative models for cell detection instead, i.e., locating and classifying cells in given pathology images. One important information that has been largely overlooked is the spatial patterns of the cells. In this paper, we propose a spatial-pattern-guided generative model for cell layout generation. Specifically, a novel diffusion model guided by spatial features and generates realistic cell layouts has been proposed. We explore different density models as spatial features for the diffusion model. In downstream tasks, we show that the generated cell layouts can be used to guide the generation of high-quality pathology images. Augmenting with these images can significantly boost the performance of SOTA cell detection methods. The code is available at https://github.com/superlc1995/Diffusion-cell.

📄 PDF Abstract BibTeX arXiv:2409.03106

Code (1)

superlc1995/diffusion-cell 공식 구현 pytorch

Tasks

Cell DetectionLayout Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Focus 설명 없음

Similar Papers 제목 키워드 기반

CoT-lized Diffusion: Let's Reinforce T2I Generation Step-by-step

2025-07-06 · Zheyuan Liu, Munan Ning, Qihui Zhang, Shuo Yang 외

Current text-to-image (T2I) generation models struggle to align spatial composition with the input text, especially in complex scenes. Even layout-based approaches yield suboptimal spatial control, as their generation pr…

DenoisingLarge Language ModelMultimodal Large Language Model

LayoutAgent: A Vision-Language Agent Guided Compositional Diffusion for Spatial Layout Planning

2025-09-24 · Zezhong Fan, Xiaohan Li, Luyi Ma, Kai Zhao 외 arxiv

Designing realistic multi-object scenes requires not only generating images, but also planning spatial layouts that respect semantic relations and physical plausibility. On one hand, while recent advances in diffusion mo…

Spatial ReasoningImage Generation

HiCo: Hierarchical Controllable Diffusion Model for Layout-to-image Generation

2024-10-18 · Bo Cheng, Yuhang Ma, Liebucha Wu, Shanyuan Liu 외

The task of layout-to-image generation involves synthesizing images based on the captions of objects and their spatial positions. Existing methods still struggle in complex layout generation, where common bad cases inclu…

DisentanglementImage GenerationLayout GenerationLayout-to-Image Generation

LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation

2023-03-30 · CVPR 2023 1 · Guangcong Zheng, Xianpan Zhou, XueWei Li, Zhongang Qi 외

Recently, diffusion models have achieved great success in image synthesis. However, when it comes to the layout-to-image generation where an image often has a complex scene of multiple objects, how to make strong control…

Image GenerationLayout-to-Image GenerationObject

LAW-Diffusion: Complex Scene Generation by Diffusion with Layouts

2023-08-13 · ICCV 2023 1 · BinBin Yang, Yi Luo, Ziliang Chen, Guangrun Wang 외

Thanks to the rapid development of diffusion models, unprecedented progress has been witnessed in image synthesis. Prior works mostly rely on pre-trained linguistic models, but a text is often too abstract to properly sp…

Image GenerationLayout-to-Image GenerationObjectScene Generation