PtychoDV: Vision Transformer-Based Deep Unrolling Network for Ptychographic Image Reconstruction
Ptychography is an imaging technique that captures multiple overlapping snapshots of a sample, illuminated coherently by a moving localized probe. The image recovery from ptychographic data is generally achieved via an iterative algorithm that solves a nonlinear phase retrieval problem derived from measured diffraction patterns. However, these iterative approaches have high computational cost. In this paper, we introduce PtychoDV, a novel deep model-based network designed for efficient, high-quality ptychographic image reconstruction. PtychoDV comprises a vision transformer that generates an initial image from the set of raw measurements, taking into consideration their mutual correlations. This is followed by a deep unrolling network that refines the initial image using learnable convolutional priors and the ptychography measurement model. Experimental results on simulated data demonstrate that PtychoDV is capable of outperforming existing deep learning methods for this problem, and significantly reduces computational cost compared to iterative methodologies, while maintaining competitive performance.
Code (1)
Tasks
Image ReconstructionRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
LWGNet: Learned Wirtinger Gradients for Fourier Ptychographic Phase Retrieval
Fourier Ptychographic Microscopy (FPM) is an imaging procedure that overcomes the traditional limit on Space-Bandwidth Product (SBP) of conventional microscopes through computational means. It utilizes multiple images ca…
RetrievalRolling Shutter CorrectionPtychoFormer: A Transformer-based Model for Ptychographic Phase Retrieval
Ptychography is a computational method of microscopy that recovers high-resolution transmission images of samples from a series of diffraction patterns. While conventional phase retrieval algorithms can iteratively recov…
RetrievalA Physics-Inspired Deep Learning Framework with Polar Coordinate Attention for Ptychographic Imaging
Ptychographic imaging confronts inherent challenges in applying deep learning for phase retrieval from diffraction patterns. Conventional neural architectures, both convolutional neural networks and Transformer-based met…
Deep LearningRetrievalSSIMAlgorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processing
Deep neural networks provide unprecedented performance gains in many real world problems in signal and image processing. Despite these gains, future development and practical deployment of deep networks is hindered by th…
Rolling Shutter CorrectionImage Gradient Decomposition for Parallel and Memory-Efficient Ptychographic Reconstruction
Ptychography is a popular microscopic imaging modality for many scientific discoveries and sets the record for highest image resolution. Unfortunately, the high image resolution for ptychographic reconstruction requires …