Multi-StyleGAN: Towards Image-Based Simulation of Time-Lapse Live-Cell Microscopy
Time-lapse fluorescent microscopy (TLFM) combined with predictive mathematical modelling is a powerful tool to study the inherently dynamic processes of life on the single-cell level. Such experiments are costly, complex and labour intensive. A complimentary approach and a step towards in silico experimentation, is to synthesise the imagery itself. Here, we propose Multi-StyleGAN as a descriptive approach to simulate time-lapse fluorescence microscopy imagery of living cells, based on a past experiment. This novel generative adversarial network synthesises a multi-domain sequence of consecutive timesteps. We showcase Multi-StyleGAN on imagery of multiple live yeast cells in microstructured environments and train on a dataset recorded in our laboratory. The simulation captures underlying biophysical factors and time dependencies, such as cell morphology, growth, physical interactions, as well as the intensity of a fluorescent reporter protein. An immediate application is to generate additional training and validation data for feature extraction algorithms or to aid and expedite development of advanced experimental techniques such as online monitoring or control of cells. Code and dataset is available at https://git.rwth-aachen.de/bcs/projects/tp/multi-stylegan.
Code (1)
Tasks
DescriptiveGenerative Adversarial NetworkTFLM sequence generationVideo GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
NoisyTwins: Class-Consistent and Diverse Image Generation through StyleGANs
StyleGANs are at the forefront of controllable image generation as they produce a latent space that is semantically disentangled, making it suitable for image editing and manipulation. However, the performance of StyleGA…
Conditional Image GenerationDiversityImage GenerationDeepLandscape: Adversarial Modeling of Landscape Video
We build a new model of landscape videos that can be trained on a mixture of static landscape images as well as landscape animations. Our architecture extends StyleGAN model by augmenting it with parts that allow to mode…
DeepLandscape: Adversarial Modeling of Landscape Videos
We build a new model of landscape videos that can be trained on a mixture of static landscape images as well as landscape animations. Our architecture extends StyleGAN model by augmenting it with parts that allow to mode…
Video GenerationAlbum cover art image generation with Generative Adversarial Networks
Generative Adversarial Networks (GANs) were introduced by Goodfellow in 2014, and since then have become popular for constructing generative artificial intelligence models. However, the drawbacks of such networks are num…
Image GenerationExploring StyleGAN Latent Space for Face Alignment with Limited Training Data
With deep learning models growing in size over the years, sometimes exceeding a billion parameters now, the need for large, annotated training datasets grows too. To alleviate this problem, the interest in self-supervise…
Face AlignmentImage GenerationSelf-Supervised Learning