Physics-enhanced machine learning for virtual fluorescence microscopy
This paper introduces a new method of data-driven microscope design for virtual fluorescence microscopy. Our results show that by including a model of illumination within the first layers of a deep convolutional neural network, it is possible to learn task-specific LED patterns that substantially improve the ability to infer fluorescence image information from unstained transmission microscopy images. We validated our method on two different experimental setups, with different magnifications and different sample types, to show a consistent improvement in performance as compared to conventional illumination methods. Additionally, to understand the importance of learned illumination on inference task, we varied the dynamic range of the fluorescent image targets (from one to seven bits), and showed that the margin of improvement for learned patterns increased with the information content of the target. This work demonstrates the power of programmable optical elements at enabling better machine learning algorithm performance and at providing physical insight into next generation of machine-controlled imaging systems.
Code (1)
Tasks
BIG-bench Machine LearningSimilar Papers 제목 키워드 기반
Three-dimensional virtual refocusing of fluorescence microscopy images using deep learning
Three-dimensional (3D) fluorescence microscopy in general requires axial scanning to capture images of a sample at different planes. Here we demonstrate that a deep convolutional neural network can be trained to virtuall…
Foreground-aware Virtual Staining for Accurate 3D Cell Morphological Profiling
Microscopy enables direct observation of cellular morphology in 3D, with transmitted-light methods offering low-cost, minimally invasive imaging and fluorescence microscopy providing specificity and contrast. Virtual sta…
Global Pixel Transformers for Virtual Staining of Microscopy Images
Visualizing the details of different cellular structures is of great importance to elucidate cellular functions. However, it is challenging to obtain high quality images of different structures directly due to complex ce…
Virtual StainingComputational TIRF enables optical sectioning beyond the evanescent field for widefield fluorescence microscopy
The resolving ability of widefield fluorescence microscopy is fundamentally limited by out-of-focus background owing to its low axial resolution, particularly for densely labeled biological samples. Although total intern…
Virtual organelle self-coding for fluorescence imaging via adversarial learning
Fluorescence microscopy plays a vital role in understanding the subcellular structures of living cells. However, it requires considerable effort in sample preparation related to chemical fixation, staining, cost, and tim…
Generative Adversarial NetworkImage SegmentationSemantic Segmentation