Physics-augmented Deep Learning with Adversarial Domain Adaptation: Applications to STM Image Denoising
Image denoising is a critical task in various scientific fields such as medical imaging and material characterization, where the accurate recovery of underlying structures from noisy data is essential. Although supervised denoising techniques have achieved significant advancements, they typically require large datasets of paired clean-noisy images for training. Unsupervised methods, while not reliant on paired data, typically necessitate a set of unpaired clean images for training, which are not always accessible. In this paper, we propose a physics-augmented deep learning with adversarial domain adaption (PDA-Net) framework for unsupervised image denoising, with applications to denoise real-world scanning tunneling microscopy (STM) images. Our PDA-Net leverages the underlying physics to simulate and envision the ground truth for denoised STM images. Additionally, built upon Generative Adversarial Networks (GANs), we incorporate a cycle-consistency module and a domain adversarial module into our PDA-Net to address the challenge of lacking paired training data and achieve information transfer between the simulated and real experimental domains. Finally, we propose to implement feature alignment and weight-sharing techniques to fully exploit the similarity between simulated and real experimental images, thereby enhancing the denoising performance in both the simulation and experimental domains. Experimental results demonstrate that the proposed PDA-Net successfully enhances the quality of STM images, offering promising applications to enhance scientific discovery and accelerate experimental quantum material research.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingDomain AdaptationImage Denoisingscientific discoveryMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Adversarial domain adaptation to reduce sample bias of a high energy physics classifier
We apply adversarial domain adaptation in unsupervised setting to reduce sample bias in a supervised high energy physics events classifier training. We make use of a neural network containing event and domain classifier …
BIG-bench Machine LearningClassificationDomain Adaptationdomain classification+1Contrastive Domain Adaptation for Time-Series via Temporal Mixup
Unsupervised Domain Adaptation (UDA) has emerged as a powerful solution for the domain shift problem via transferring the knowledge from a labeled source domain to a shifted unlabeled target domain. Despite the prevalenc…
Contrastive LearningDomain AdaptationTime SeriesTime Series Analysis+1Robust Domain Adaptation By Augmented Cyclic Adversarial Learning
Training a model to perform a task typically requires a large amount of data from the domains in which the task will be applied. However, it is often the case that data are abundant in some domains but scarce in others. …
Domain Adaptationspeech-recognitionSpeech RecognitionUnsupervised Domain AdaptationAdversarial Domain Adaptation for Action Recognition Around the Clock
Due to the numerous potential applications in visual surveillance and nighttime driving, recognizing human action in low-light conditions remains a difficult problem in computer vision. Existing methods separate action r…
Action ClassificationAction RecognitionDomain AdaptationAFAN: Augmented Feature Alignment Network for Cross-Domain Object Detection
Unsupervised domain adaptation for object detection is a challenging problem with many real-world applications. Unfortunately, it has received much less attention than supervised object detection. Models that try to addr…
Domain AdaptationImage GenerationObjectobject-detection+2