paper-with-me

홈 › Papers

Adaptive Image Sampling using Deep Learning and its Application on X-Ray Fluorescence Image Reconstruction

2018-12-27 · Qiqin Dai, Henry Chopp, Emeline Pouyet, Oliver Cossairt, Marc Walton, Aggelos K. Katsaggelos

This paper presents an adaptive image sampling algorithm based on Deep Learning (DL). The adaptive sampling mask generation network is jointly trained with an image inpainting network. The sampling rate is controlled in the mask generation network, and a binarization strategy is investigated to make the sampling mask binary. Besides the image sampling and reconstruction application, we show that the proposed adaptive sampling algorithm is able to speed up raster scan processes such as the X-Ray fluorescence (XRF) image scanning process. Recently XRF laboratory-based systems have evolved to lightweight and portable instruments thanks to technological advancements in both X-Ray generation and detection. However, the scanning time of an XRF image is usually long due to the long exposures requires (e.g., $100 \mu s-1ms$ per point). We propose an XRF image inpainting approach to address the issue of long scanning time, thus speeding up the scanning process while still maintaining the possibility to reconstruct a high quality XRF image. The proposed adaptive image sampling algorithm is applied to the RGB image of the scanning target to generate the sampling mask. The XRF scanner is then driven according to the sampling mask to scan a subset of the total image pixels. Finally, we inpaint the scanned XRF image by fusing the RGB image to reconstruct the full scan XRF image. The experiments show that the proposed adaptive sampling algorithm is able to effectively sample the image and achieve a better reconstruction accuracy than that of the existing methods.

📄 PDF Abstract BibTeX arXiv:1812.10836

Code (3)

usstdqq/deep-adaptive-sampling-mask 공식 구현 pytorch
weiwang2330/deep-adaptive-sampling pytorch
weiwang2330/deep-adaptive-sampling-mask pytorch

Tasks

BinarizationImage InpaintingImage Reconstruction

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Multiplexed Immunofluorescence Brain Image Analysis Using Self-Supervised Dual-Loss Adaptive Masked Autoencoder

2022-05-10 · Son T. Ly, Bai Lin, Hung Q. Vo, Dragan Maric 외

Reliable large-scale cell detection and segmentation is the fundamental first step to understanding biological processes in the brain. The ability to phenotype cells at scale can accelerate preclinical drug evaluation an…

Cell DetectionContrastive LearningImage ReconstructionSegmentation+2

Adaptive Weighting Depth-variant Deconvolution of Fluorescence Microscopy Images with Convolutional Neural Network

2019-07-07 · Da He, De Cai, Jiasheng Zhou, Jiajia Luo 외

Fluorescence microscopy plays an important role in biomedical research. The depth-variant point spread function (PSF) of a fluorescence microscope produces low-quality images especially in the out-of-focus regions of thi…

Modality Attention and Sampling Enables Deep Learning with Heterogeneous Marker Combinations in Fluorescence Microscopy

2020-08-27 · Alvaro Gomariz, Tiziano Portenier, Patrick M. Helbling, Stephan Isringhausen 외

Fluorescence microscopy allows for a detailed inspection of cells, cellular networks, and anatomical landmarks by staining with a variety of carefully-selected markers visualized as color channels. Quantitative character…

Global Pixel Transformers for Virtual Staining of Microscopy Images

2019-07-01 · Yi Liu, Hao Yuan, Zhengyang Wang, Shuiwang Ji

Visualizing the details of different cellular structures is of great importance to elucidate cellular functions. However, it is challenging to obtain high quality images of different structures directly due to complex ce…

Virtual Staining

Design by adaptive sampling

2018-10-08 · David H. Brookes, Jennifer Listgarten

We present a probabilistic modeling framework and adaptive sampling algorithm wherein unsupervised generative models are combined with black box predictive models to tackle the problem of input design. In input design, o…