Efficient Pairwise Neuroimage Analysis using the Soft Jaccard Index and 3D Keypoint Sets
We propose a novel pairwise distance measure between image keypoint sets, for the purpose of large-scale medical image indexing. Our measure generalizes the Jaccard index to account for soft set equivalence (SSE) between keypoint elements, via an adaptive kernel framework modeling uncertainty in keypoint appearance and geometry. A new kernel is proposed to quantify the variability of keypoint geometry in location and scale. Our distance measure may be estimated between $O(N^2)$ image pairs in $O(N~\log~N)$ operations via keypoint indexing. Experiments report the first results for the task of predicting family relationships from medical images, using 1010 T1-weighted MRI brain volumes of 434 families including monozygotic and dizygotic twins, siblings and half-siblings sharing 100%-25% of their polymorphic genes. Soft set equivalence and the keypoint geometry kernel improve upon standard hard set equivalence (HSE) and appearance kernels alone in predicting family relationships. Monozygotic twin identification is near 100%, and three subjects with uncertain genotyping are automatically paired with their self-reported families, the first reported practical application of image-based family identification. Our distance measure can also be used to predict group categories, sex is predicted with an AUC=0.97. Software is provided for efficient fine-grained curation of large, generic image datasets.
Code (1)
Similar Papers 제목 키워드 기반
A Keypoint-based Morphological Signature for Large-scale Neuroimage Analysis
We present an image keypoint-based morphological signature that can be used to efficiently assess the pair-wise whole-brain similarity for large MRI datasets. Similarity is assessed via Jaccard-like measure of set overla…
Image RetrievalRetrievalOptimization for Medical Image Segmentation: Theory and Practice when evaluating with Dice Score or Jaccard Index
In many medical imaging and classical computer vision tasks, the Dice score and Jaccard index are used to evaluate the segmentation performance. Despite the existence and great empirical success of metric-sensitive losse…
Image SegmentationMedical Image SegmentationSegmentationSemantic SegmentationEstimating Jaccard Index with Missing Observations: A Matrix Calibration Approach
The Jaccard index is a standard statistics for comparing the pairwise similarity between data samples. This paper investigates the problem of estimating a Jaccard index matrix when there are missing observations in data …
Optimizing the Dice Score and Jaccard Index for Medical Image Segmentation: Theory & Practice
The Dice score and Jaccard index are commonly used metrics for the evaluation of segmentation tasks in medical imaging. Convolutional neural networks trained for image segmentation tasks are usually optimized for (weight…
Image SegmentationMedical Image SegmentationSegmentationSemantic SegmentationJaccard Metric Losses: Optimizing the Jaccard Index with Soft Labels
Intersection over Union (IoU) losses are surrogates that directly optimize the Jaccard index. Leveraging IoU losses as part of the loss function have demonstrated superior performance in semantic segmentation tasks compa…
Knowledge DistillationSemantic Segmentation