Generalized Organ Segmentation by Imitating One-shot Reasoning using Anatomical Correlation
Learning by imitation is one of the most significant abilities of human beings and plays a vital role in human's computational neural system. In medical image analysis, given several exemplars (anchors), experienced radiologist has the ability to delineate unfamiliar organs by imitating the reasoning process learned from existing types of organs. Inspired by this observation, we propose OrganNet which learns a generalized organ concept from a set of annotated organ classes and then transfer this concept to unseen classes. In this paper, we show that such process can be integrated into the one-shot segmentation task which is a very challenging but meaningful topic. We propose pyramid reasoning modules (PRMs) to model the anatomical correlation between anchor and target volumes. In practice, the proposed module first computes a correlation matrix between target and anchor computerized tomography (CT) volumes. Then, this matrix is used to transform the feature representations of both anchor volume and its segmentation mask. Finally, OrganNet learns to fuse the representations from various inputs and predicts segmentation results for target volume. Extensive experiments show that OrganNet can effectively resist the wide variations in organ morphology and produce state-of-the-art results in one-shot segmentation task. Moreover, even when compared with fully-supervised segmentation models, OrganNet is still able to produce satisfying segmentation results.
Code (0)
등록된 구현이 없습니다.
Tasks
Medical Image AnalysisOne-Shot SegmentationOrgan SegmentationSegmentationSimilar Papers 제목 키워드 기반
Generalized Few-Shot Semantic Segmentation in Remote Sensing: Challenge and Benchmark
Learning with limited labelled data is a challenging problem in various applications, including remote sensing. Few-shot semantic segmentation is one approach that can encourage deep learning models to learn from few lab…
Few-Shot Semantic SegmentationGeneralized Few-Shot Semantic SegmentationSegmentationSemantic SegmentationImplicit Shape-Prior for Few-Shot Assisted 3D Segmentation
The objective of this paper is to significantly reduce the manual workload required from medical professionals in complex 3D segmentation tasks that cannot be yet fully automated. For instance, in radiotherapy planning, …
A Unified Framework for Generalized Low-Shot Medical Image Segmentation with Scarce Data
Medical image segmentation has achieved remarkable advancements using deep neural networks (DNNs). However, DNNs often need big amounts of data and annotations for training, both of which can be difficult and costly to o…
Image SegmentationMedical Image SegmentationMetric LearningSegmentation+1AR-VRM: Imitating Human Motions for Visual Robot Manipulation with Analogical Reasoning
Visual Robot Manipulation (VRM) aims to enable a robot to follow natural language instructions based on robot states and visual observations, and therefore requires costly multi-modal data. To compensate for the deficien…
Robot ManipulationFAMNet: Frequency-aware Matching Network for Cross-domain Few-shot Medical Image Segmentation
Existing few-shot medical image segmentation (FSMIS) models fail to address a practical issue in medical imaging: the domain shift caused by different imaging techniques, which limits the applicability to current FSMIS t…
Cross-Domain Few-ShotDomain GeneralizationFew-Shot Semantic SegmentationImage Segmentation+4