Exploring Generative Adversarial Networks for Image-to-Image Translation in STEM Simulation
The use of accurate scanning transmission electron microscopy (STEM) image simulation methods require large computation times that can make their use infeasible for the simulation of many images. Other simulation methods based on linear imaging models, such as the convolution method, are much faster but are too inaccurate to be used in application. In this paper, we explore deep learning models that attempt to translate a STEM image produced by the convolution method to a prediction of the high accuracy multislice image. We then compare our results to those of regression methods. We find that using the deep learning model Generative Adversarial Network (GAN) provides us with the best results and performs at a similar accuracy level to previous regression models on the same dataset. Codes and data for this project can be found in this GitHub repository, https://github.com/uw-cmg/GAN-STEM-Conv2MultiSlice.
Code (1)
Tasks
Deep LearningGenerative Adversarial NetworkImage-to-Image TranslationregressionTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Segmentation Guided Image-to-Image Translation with Adversarial Networks
Recently image-to-image translation has received increasing attention, which aims to map images in one domain to another specific one. Existing methods mainly solve this task via a deep generative model, and focus on exp…
Image-to-Image TranslationSegmentationSemantic SegmentationTranslationExploring the Power of Generative Deep Learning for Image-to-Image Translation and MRI Reconstruction: A Cross-Domain Review
Deep learning has become a prominent computational modeling tool in the areas of computer vision and image processing in recent years. This research comprehensively analyzes the different deep-learning methods used for i…
Deep LearningImage-to-Image TranslationMRI ReconstructionTranslationHierarchical Modes Exploring in Generative Adversarial Networks
In conditional Generative Adversarial Networks (cGANs), when two different initial noises are concatenated with the same conditional information, the distance between their outputs is relatively smaller, which makes mino…
DiversityImage GenerationText to Image GenerationText-to-Image Generation+1Semi-Supervised Image-to-Image Translation
Image-to-image translation is a long-established and a difficult problem in computer vision. In this paper we propose an adversarial based model for image-to-image translation. The regular deep neural-network based metho…
Generative Adversarial NetworkImage SegmentationImage-to-Image TranslationMultimodal Unsupervised Image-To-Image Translation+4Multi-Modality Image Inpainting using Generative Adversarial Networks
Deep learning techniques, especially Generative Adversarial Networks (GANs) have significantly improved image inpainting and image-to-image translation tasks over the past few years. To the best of our knowledge, the pro…
Image InpaintingImage-to-Image TranslationTranslation