MONET -- Virtual Cell Painting of Brightfield Images and Time Lapses Using Reference Consistent Diffusion
Cell painting is a popular technique for creating human-interpretable, high-contrast images of cell morphology. There are two major issues with cell paint: (1) it is labor-intensive and (2) it requires chemical fixation, making the study of cell dynamics impossible. We train a diffusion model (Morphological Observation Neural Enhancement Tool, or MONET) on a large dataset to predict cell paint channels from brightfield images. We show that model quality improves with scale. The model uses a consistency architecture to generate time-lapse videos, despite the impossibility of obtaining cell paint video training data. In addition, we show that this architecture enables a form of in-context learning, allowing the model to partially transfer to out-of-distribution cell lines and imaging protocols. Virtual cell painting is not intended to replace physical cell painting completely, but to act as a complementary tool enabling novel workflows in biological research.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Can Generative AI Replace Immunofluorescent Staining Processes? A Comparison Study of Synthetically Generated CellPainting Images from Brightfield
Cell imaging assays utilizing fluorescence stains are essential for observing sub-cellular organelles and their responses to perturbations. Immunofluorescent staining process is routinely in labs, however the recent inno…
Image GenerationDiffusion-Based Synthetic Brightfield Microscopy Images for Enhanced Single Cell Detection
Accurate single cell detection in brightfield microscopy is crucial for biological research, yet data scarcity and annotation bottlenecks limit the progress of deep learning methods. We investigate the use of uncondition…
Synthetic Data GenerationObject DetectionCell DetectionUnsupervised organization of cervical cells using high resolution digital holographic microscopy
We report results on unsupervised organization of cervical cells using microscopy of Pap-smear samples in brightfield (3-channel colour) as well as high resolution quantitative phase imaging modalities. A number of morph…
Image ClusteringVocal Bursts Intensity PredictionClass-Guided Image-to-Image Diffusion: Cell Painting from Brightfield Images with Class Labels
Image-to-image reconstruction problems with free or inexpensive metadata in the form of class labels appear often in biological and medical image domains. Existing text-guided or style-transfer image-to-image approaches …
DenoisingDrug DiscoveryImage ReconstructionStyle TransferLearning to segment clustered amoeboid cells from brightfield microscopy via multi-task learning with adaptive weight selection
Detecting and segmenting individual cells from microscopy images is critical to various life science applications. Traditional cell segmentation tools are often ill-suited for applications in brightfield microscopy due t…
Boundary DetectionCell SegmentationMulti-Task Learning