Generalizable Denoising of Microscopy Images using Generative Adversarial Networks and Contrastive Learning
Microscopy images often suffer from high levels of noise, which can hinder further analysis and interpretation. Content-aware image restoration (CARE) methods have been proposed to address this issue, but they often require large amounts of training data and suffer from over-fitting. To overcome these challenges, we propose a novel framework for few-shot microscopy image denoising. Our approach combines a generative adversarial network (GAN) trained via contrastive learning (CL) with two structure preserving loss terms (Structural Similarity Index and Total Variation loss) to further improve the quality of the denoised images using little data. We demonstrate the effectiveness of our method on three well-known microscopy imaging datasets, and show that we can drastically reduce the amount of training data while retaining the quality of the denoising, thus alleviating the burden of acquiring paired data and enabling few-shot learning. The proposed framework can be easily extended to other image restoration tasks and has the potential to significantly advance the field of microscopy image analysis.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningDenoisingFew-Shot LearningGenerative Adversarial NetworkImage DenoisingImage RestorationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
QWD-GAN: Quality-aware Wavelet-driven GAN for Unsupervised Medical Microscopy Images Denoising
Image denoising plays a critical role in biomedical and microscopy imaging, especially when acquiring wide-field fluorescence-stained images. This task faces challenges in multiple fronts, including limitations in image …
Image DenoisingGenerative Adversarial Networks for Robust Cryo-EM Image Denoising
The cryo-electron microscopy (Cryo-EM) becomes popular for macromolecular structure determination. However, the 2D images which Cryo-EM detects are of high noise and often mixed with multiple heterogeneous conformations …
3D ReconstructionClusteringDenoisingImage Denoising+1Physics-augmented Deep Learning with Adversarial Domain Adaptation: Applications to STM Image Denoising
Image denoising is a critical task in various scientific fields such as medical imaging and material characterization, where the accurate recovery of underlying structures from noisy data is essential. Although supervise…
DenoisingDomain AdaptationImage Denoisingscientific discoveryThree dimensional blind image deconvolution for fluorescence microscopy using generative adversarial networks
Due to image blurring image deconvolution is often used for studying biological structures in fluorescence microscopy. Fluorescence microscopy image volumes inherently suffer from intensity inhomogeneity, blur, and are c…
DenoisingImage DeconvolutionSelf-Supervised Learning with Generative Adversarial Networks for Electron Microscopy
In this work, we explore the potential of self-supervised learning with Generative Adversarial Networks (GANs) for electron microscopy datasets. We show how self-supervised pretraining facilitates efficient fine-tuning f…
DenoisingSelf-Supervised LearningSemantic SegmentationSuper-Resolution