Photoacoustic image synthesis with generative adversarial networks
Photoacoustic tomography (PAT) has the potential to recover morphological and functional tissue properties with high spatial resolution. However, previous attempts to solve the optical inverse problem with supervised machine learning were hampered by the absence of labeled reference data. While this bottleneck has been tackled by simulating training data, the domain gap between real and simulated images remains an unsolved challenge. We propose a novel approach to PAT image synthesis that involves subdividing the challenge of generating plausible simulations into two disjoint problems: (1) Probabilistic generation of realistic tissue morphology, and (2) pixel-wise assignment of corresponding optical and acoustic properties. The former is achieved with Generative Adversarial Networks (GANs) trained on semantically annotated medical imaging data. According to a validation study on a downstream task our approach yields more realistic synthetic images than the traditional model-based approach and could therefore become a fundamental step for deep learning-based quantitative PAT (qPAT).
Code (0)
등록된 구현이 없습니다.
Tasks
Image GenerationSemantic SegmentationSimilar Papers 제목 키워드 기반
DensePANet: An improved generative adversarial network for photoacoustic tomography image reconstruction from sparse data
Image reconstruction is an essential step of every medical imaging method, including Photoacoustic Tomography (PAT), which is a promising modality of imaging, that unites the benefits of both ultrasound and optical imagi…
Generative Adversarial NetworkImage GenerationImage ReconstructionScore-based Generative Models for Photoacoustic Image Reconstruction with Rotation Consistency Constraints
Photoacoustic tomography (PAT) is a newly emerged imaging modality which enables both high optical contrast and acoustic depth of penetration. Reconstructing images of photoacoustic tomography from limited amount of sens…
Image ReconstructionDe-Noising of Photoacoustic Microscopy Images by Deep Learning
As a hybrid imaging technology, photoacoustic microscopy (PAM) imaging suffers from noise due to the maximum permissible exposure of laser intensity, attenuation of ultrasound in the tissue, and the inherent noise of the…
Deep LearningGenerative Adversarial NetworkPhotoacoustic Silk Scaffolds for Neural stimulation and Regeneration
Neural interfaces using biocompatible scaffolds provide crucial properties for the functional repair of nerve injuries and neurodegenerative diseases, including cell adhesion, structural support, and mass transport. Neur…
An Introduction to Image Synthesis with Generative Adversarial Nets
There has been a drastic growth of research in Generative Adversarial Nets (GANs) in the past few years. Proposed in 2014, GAN has been applied to various applications such as computer vision and natural language process…
Image GenerationImage-to-Image TranslationTranslation