Class-Guided Image-to-Image Diffusion: Cell Painting from Brightfield Images with Class Labels
Image-to-image reconstruction problems with free or inexpensive metadata in the form of class labels appear often in biological and medical image domains. Existing text-guided or style-transfer image-to-image approaches do not translate to datasets where additional information is provided as discrete classes. We introduce and implement a model which combines image-to-image and class-guided denoising diffusion probabilistic models. We train our model on a real-world dataset of microscopy images used for drug discovery, with and without incorporating metadata labels. By exploring the properties of image-to-image diffusion with relevant labels, we show that class-guided image-to-image diffusion can improve the meaningful content of the reconstructed images and outperform the unguided model in useful downstream tasks.
Code (1)
Tasks
DenoisingDrug DiscoveryImage ReconstructionStyle TransferMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Spatial Diffusion for Cell Layout Generation
Generative models, such as GANs and diffusion models, have been used to augment training sets and boost performances in different tasks. We focus on generative models for cell detection instead, i.e., locating and classi…
Cell DetectionLayout GenerationLOTA: Bit-Planes Guided AI-Generated Image Detection
The rapid advancement of GAN and Diffusion models makes it more difficult to distinguish AI-generated images from real ones. Recent studies often use image-based reconstruction errors as an important feature for determin…
Image GenerationMarigold-DC: Zero-Shot Monocular Depth Completion with Guided Diffusion
Depth completion upgrades sparse depth measurements into dense depth maps guided by a conventional image. Existing methods for this highly ill-posed task operate in tightly constrained settings and tend to struggle when …
DenoisingDepth CompletionDepth EstimationMonocular Depth Estimation+1On Distillation of Guided Diffusion Models
Classifier-free guided diffusion models have recently been shown to be highly effective at high-resolution image generation, and they have been widely used in large-scale diffusion frameworks including DALLE-2, Stable Di…
DenoisingImage Generationtext-guided-image-editingA Diffusion Model Predicts 3D Shapes from 2D Microscopy Images
Diffusion models are a special type of generative model, capable of synthesising new data from a learnt distribution. We introduce DISPR, a diffusion-based model for solving the inverse problem of three-dimensional (3D) …
Data Augmentation