Convolutional neural networks that teach microscopes how to image
Deep learning algorithms offer a powerful means to automatically analyze the content of medical images. However, many biological samples of interest are primarily transparent to visible light and contain features that are difficult to resolve with a standard optical microscope. Here, we use a convolutional neural network (CNN) not only to classify images, but also to optimize the physical layout of the imaging device itself. We increase the classification accuracy of a microscope's recorded images by merging an optical model of image formation into the pipeline of a CNN. The resulting network simultaneously determines an ideal illumination arrangement to highlight important sample features during image acquisition, along with a set of convolutional weights to classify the detected images post-capture. We demonstrate our joint optimization technique with an experimental microscope configuration that automatically identifies malaria-infected cells with 5-10% higher accuracy than standard and alternative microscope lighting designs.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Deep learning enhanced mobile-phone microscopy
Mobile-phones have facilitated the creation of field-portable, cost-effective imaging and sensing technologies that approach laboratory-grade instrument performance. However, the optical imaging interfaces of mobile-phon…
Deep LearningTowards Low-Cost and Efficient Malaria Detection
Malaria, a fatal but curable disease claims hundreds of thousands of lives every year. Early and correct diagnosis is vital to avoid health complexities, however, it depends upon the availability of costly microscopes an…
DiagnosticDomain AdaptationInterpretation of Confocal ISO 21073: 2019 confocal microscopes: Optical data of fluorescence confocal microscopes for biological imaging- Recommended Methodology for Quality Control
The performance of a confocal imaging system may be no better than a general-purpose widefield system if it is not properly maintained or quality controlled. The publication of ISO 21073, 'Confocal microscopes- Optical d…
An open-source software package for on-the-fly deskewing and live viewing of volumetric lightsheet microscopy data
Oblique plane microscopy, OPM, is a form of lightsheet microscopy that permits volumetric imaging of biological samples at high temporal and spatial resolution. However, the imaging geometry of OPM, and related variants …
GPUNavigateRethinking low-cost microscopy workflow: Image enhancement using deep based Extended Depth of Field methods
Microscopic techniques in low-to-middle income countries are constrained by the lack of adequate equipment and trained operators. Since light microscopy delivers crucial methods for the diagnosis and screening of numerou…
BenchmarkingImage DeblurringImage EnhancementMulti-Focus Microscopical Images Fusion