GANPOP: Generative Adversarial Network Prediction of Optical Properties from Single Snapshot Wide-field Images
We present a deep learning framework for wide-field, content-aware estimation of absorption and scattering coefficients of tissues, called Generative Adversarial Network Prediction of Optical Properties (GANPOP). Spatial frequency domain imaging is used to obtain ground-truth optical properties from in vivo human hands, freshly resected human esophagectomy samples and homogeneous tissue phantoms. Images of objects with either flat-field or structured illumination are paired with registered optical property maps and are used to train conditional generative adversarial networks that estimate optical properties from a single input image. We benchmark this approach by comparing GANPOP to a single-snapshot optical property (SSOP) technique, using a normalized mean absolute error (NMAE) metric. In human gastrointestinal specimens, GANPOP estimates both reduced scattering and absorption coefficients at 660 nm from a single 0.2/mm spatial frequency illumination image with 58% higher accuracy than SSOP. When applied to both in vivo and ex vivo swine tissues, a GANPOP model trained solely on human specimens and phantoms estimates optical properties with approximately 43% improvement over SSOP, indicating adaptability to sample variety. Moreover, we demonstrate that GANPOP estimates optical properties from flat-field illumination images with similar error to SSOP, which requires structured-illumination. Given a training set that appropriately spans the target domain, GANPOP has the potential to enable rapid and accurate wide-field measurements of optical properties, even from conventional imaging systems with flat-field illumination.
Code (0)
등록된 구현이 없습니다.
Tasks
Generative Adversarial NetworkSimilar Papers 제목 키워드 기반
Materials Representation and Transfer Learning for Multi-Property Prediction
The adoption of machine learning in materials science has rapidly transformed materials property prediction. Hurdles limiting full capitalization of recent advancements in machine learning include the limited development…
BIG-bench Machine LearningGenerative Adversarial NetworkMulti-target regressionPrediction+3Photoacoustic image synthesis with generative adversarial networks
Photoacoustic tomography (PAT) has the potential to recover morphological and functional tissue properties with high spatial resolution. However, previous attempts to solve the optical inverse problem with supervised mac…
Image GenerationSemantic SegmentationTraining Generative Adversarial Networks for Optical Property Mapping using Synthetic Image Data
We demonstrate training of a Generative Adversarial Network (GAN) for prediction of optical property maps (scattering and absorption) using spatial frequency domain imaging (SFDI) image data sets generated synthetically …
Domain AdaptationGenerative Adversarial NetworkSuccessive Training of a Generative Adversarial Network for the Design of an Optical Cloak
We present an optimization algorithm based on a deep convolution generative adversarial network (DCGAN) to design a 2-Dimensional optical cloak. The optical cloak consists in a shell of uniform and isotropical dielectric…
Generative Adversarial NetworkCloud Removal for Remote Sensing Imagery via Spatial Attention Generative Adversarial Network
Optical remote sensing imagery has been widely used in many fields due to its high resolution and stable geometric properties. However, remote sensing imagery is inevitably affected by climate, especially clouds. Removin…
Cloud RemovalGenerative Adversarial NetworkSingle Particle Analysis