Self-Supervised Learning with Generative Adversarial Networks for Electron Microscopy
In this work, we explore the potential of self-supervised learning with Generative Adversarial Networks (GANs) for electron microscopy datasets. We show how self-supervised pretraining facilitates efficient fine-tuning for a spectrum of downstream tasks, including semantic segmentation, denoising, noise \& background removal, and super-resolution. Experimentation with varying model complexities and receptive field sizes reveals the remarkable phenomenon that fine-tuned models of lower complexity consistently outperform more complex models with random weight initialization. We demonstrate the versatility of self-supervised pretraining across various downstream tasks in the context of electron microscopy, allowing faster convergence and better performance. We conclude that self-supervised pretraining serves as a powerful catalyst, being especially advantageous when limited annotated data are available and efficient scaling of computational cost is important.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingSelf-Supervised LearningSemantic SegmentationSuper-ResolutionSimilar Papers 제목 키워드 기반
Advances in Electron Microscopy with Deep Learning
This doctoral thesis covers some of my advances in electron microscopy with deep learning. Highlights include a comprehensive review of deep learning in electron microscopy; large new electron microscopy datasets for mac…
Clusteringcompressed sensingDeep LearningPhilosophyLeveraging generative adversarial networks to create realistic scanning transmission electron microscopy images
The rise of automation and machine learning (ML) in electron microscopy has the potential to revolutionize materials research through autonomous data collection and processing. A significant challenge lies in developing …
Generative Adversarial NetworkGAN with Skip Patch Discriminator for Biological Electron Microscopy Image Generation
Generating realistic electron microscopy (EM) images has been a challenging problem due to their complex global and local structures. Isola et al. proposed pix2pix, a conditional Generative Adversarial Network (GAN), for…
Generative Adversarial NetworkImage GenerationImage-to-Image TranslationTranslationInstance Segmentation of Unlabeled Modalities via Cyclic Segmentation GAN
Instance segmentation for unlabeled imaging modalities is a challenging but essential task as collecting expert annotation can be expensive and time-consuming. Existing works segment a new modality by either deploying a …
Generative Adversarial NetworkImage SegmentationInstance SegmentationSegmentation+2Resolution enhancement in scanning electron microscopy using deep learning
We report resolution enhancement in scanning electron microscopy (SEM) images using a generative adversarial network. We demonstrate the veracity of this deep learning-based super-resolution technique by inferring unreso…
Deep LearningGenerative Adversarial NetworkSuper-Resolution