Utilizing Uncertainty Estimation in Deep Learning Segmentation of Fluorescence Microscopy Images with Missing Markers
Fluorescence microscopy images contain several channels, each indicating a marker staining the sample. Since many different marker combinations are utilized in practice, it has been challenging to apply deep learning based segmentation models, which expect a predefined channel combination for all training samples as well as at inference for future application. Recent work circumvents this problem using a modality attention approach to be effective across any possible marker combination. However, for combinations that do not exist in a labeled training dataset, one cannot have any estimation of potential segmentation quality if that combination is encountered during inference. Without this, not only one lacks quality assurance but one also does not know where to put any additional imaging and labeling effort. We herein propose a method to estimate segmentation quality on unlabeled images by (i) estimating both aleatoric and epistemic uncertainties of convolutional neural networks for image segmentation, and (ii) training a Random Forest model for the interpretation of uncertainty features via regression to their corresponding segmentation metrics. Additionally, we demonstrate that including these uncertainty measures during training can provide an improvement on segmentation performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Image SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Tubule segmentation of fluorescence microscopy images based on convolutional neural networks with inhomogeneity correction
Fluorescence microscopy has become a widely used tool for studying various biological structures of in vivo tissue or cells. However, quantitative analysis of these biological structures remains a challenge due to their …
Data AugmentationSegmentationCenter-Extraction-Based Three Dimensional Nuclei Instance Segmentation of Fluorescence Microscopy Images
Fluorescence microscopy is an essential tool for the analysis of 3D subcellular structures in tissue. An important step in the characterization of tissue involves nuclei segmentation. In this paper, a two-stage method fo…
Instance SegmentationSegmentationSemantic SegmentationThree Dimensional Fluorescence Microscopy Image Synthesis and Segmentation
Advances in fluorescence microscopy enable acquisition of 3D image volumes with better image quality and deeper penetration into tissue. Segmentation is a required step to characterize and analyze biological structures i…
Deep LearningImage GenerationSegmentationConvolutional Neural Network Denoising in Fluorescence Lifetime Imaging Microscopy (FLIM)
Fluorescence lifetime imaging microscopy (FLIM) systems are limited by their slow processing speed, low signal-to-noise ratio (SNR), and expensive and challenging hardware setups. In this work, we demonstrate applying a …
ClusteringDeep LearningDenoisingImage Denoising+1Segmentation of Clustered Nuclei With Shape Markers and Marking Function
We present a method to separate clustered nuclei from fluorescence microscopy cellular images, using shape markers and marking function in a watershed-like algorithm. Shape markers are extracted using an adaptive H-mi…
Cell SegmentationSegmentation