Deep learning at the edge enables real-time streaming ptychographic imaging
Coherent microscopy techniques provide an unparalleled multi-scale view of materials across scientific and technological fields, from structural materials to quantum devices, from integrated circuits to biological cells. Driven by the construction of brighter sources and high-rate detectors, coherent X-ray microscopy methods like ptychography are poised to revolutionize nanoscale materials characterization. However, associated significant increases in data and compute needs mean that conventional approaches no longer suffice for recovering sample images in real-time from high-speed coherent imaging experiments. Here, we demonstrate a workflow that leverages artificial intelligence at the edge and high-performance computing to enable real-time inversion on X-ray ptychography data streamed directly from a detector at up to 2 kHz. The proposed AI-enabled workflow eliminates the sampling constraints imposed by traditional ptychography, allowing low dose imaging using orders of magnitude less data than required by traditional methods.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Live Iterative Ptychography with projection-based algorithms
In this work, we demonstrate that the ptychographic phase problem can be solved in a live fashion during scanning, while data is still being collected. We propose a generally applicable modification of the widespread pro…
RetrievalMachine Learning-Augmented Acceleration of Iterative Ptychographic Reconstruction
Iterative ptychographic reconstruction algorithms are widely used for coherent diffractive imaging but can exhibit slow convergence under realistic experimental conditions. We propose a machine learning-augmented approac…
StreamingRAG: Real-time Contextual Retrieval and Generation Framework
Extracting real-time insights from multi-modal data streams from various domains such as healthcare, intelligent transportation, and satellite remote sensing remains a challenge. High computational demands and limited kn…
Knowledge GraphsRAGRetrievalRetrieval-augmented GenerationImage Gradient Decomposition for Parallel and Memory-Efficient Ptychographic Reconstruction
Ptychography is a popular microscopic imaging modality for many scientific discoveries and sets the record for highest image resolution. Unfortunately, the high image resolution for ptychographic reconstruction requires …
Integrating Generative and Physics-Based Models for Ptychographic Imaging with Uncertainty Quantification
Ptychography is a scanning coherent diffractive imaging technique that enables imaging nanometer-scale features in extended samples. One main challenge is that widely used iterative image reconstruction methods often req…
Image ReconstructionUncertainty Quantification