paper-with-me

Papers

Self-Supervised Learning with Generative Adversarial Networks for Electron Microscopy

2024-02-28 · Bashir Kazimi, Karina Ruzaeva, Stefan Sandfeld

In this work, we explore the potential of self-supervised learning with Generative Adversarial Networks (GANs) for electron microscopy datasets. We show how self-supervised pretraining facilitates efficient fine-tuning for a spectrum of downstream tasks, including semantic segmentation, denoising, noise \& background removal, and super-resolution. Experimentation with varying model complexities and receptive field sizes reveals the remarkable phenomenon that fine-tuned models of lower complexity consistently outperform more complex models with random weight initialization. We demonstrate the versatility of self-supervised pretraining across various downstream tasks in the context of electron microscopy, allowing faster convergence and better performance. We conclude that self-supervised pretraining serves as a powerful catalyst, being especially advantageous when limited annotated data are available and efficient scaling of computational cost is important.

📄 PDF Abstract BibTeX arXiv:2402.18286

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingSelf-Supervised LearningSemantic SegmentationSuper-Resolution

Similar Papers 제목 키워드 기반

Advances in Electron Microscopy with Deep Learning

2021-01-04 · Jeffrey M. Ede

This doctoral thesis covers some of my advances in electron microscopy with deep learning. Highlights include a comprehensive review of deep learning in electron microscopy; large new electron microscopy datasets for mac…

Clusteringcompressed sensingDeep LearningPhilosophy

Leveraging generative adversarial networks to create realistic scanning transmission electron microscopy images

2023-01-18 · Abid Khan, Chia-Hao Lee, Pinshane Y. Huang, Bryan K. Clark

The rise of automation and machine learning (ML) in electron microscopy has the potential to revolutionize materials research through autonomous data collection and processing. A significant challenge lies in developing …

Generative Adversarial Network

GAN with Skip Patch Discriminator for Biological Electron Microscopy Image Generation

2024-03-31 · Nishith Ranjon Roy, Nailah Rawnaq, Tulin Kaman

Generating realistic electron microscopy (EM) images has been a challenging problem due to their complex global and local structures. Isola et al. proposed pix2pix, a conditional Generative Adversarial Network (GAN), for…

Generative Adversarial NetworkImage GenerationImage-to-Image TranslationTranslation

Instance Segmentation of Unlabeled Modalities via Cyclic Segmentation GAN

2022-04-06 · Leander Lauenburg, Zudi Lin, Ruihan Zhang, Márcia dos Santos 외

Instance segmentation for unlabeled imaging modalities is a challenging but essential task as collecting expert annotation can be expensive and time-consuming. Existing works segment a new modality by either deploying a …

Generative Adversarial NetworkImage SegmentationInstance SegmentationSegmentation+2

Resolution enhancement in scanning electron microscopy using deep learning

2019-01-30 · Kevin de Haan, Zachary S. Ballard, Yair Rivenson, Yichen Wu 외

We report resolution enhancement in scanning electron microscopy (SEM) images using a generative adversarial network. We demonstrate the veracity of this deep learning-based super-resolution technique by inferring unreso…

Deep LearningGenerative Adversarial NetworkSuper-Resolution