Transformer based multiple instance learning for weakly supervised histopathology image segmentation
Hispathological image segmentation algorithms play a critical role in computer aided diagnosis technology. The development of weakly supervised segmentation algorithm alleviates the problem of medical image annotation that it is time-consuming and labor-intensive. As a subset of weakly supervised learning, Multiple Instance Learning (MIL) has been proven to be effective in segmentation. However, there is a lack of related information between instances in MIL, which limits the further improvement of segmentation performance. In this paper, we propose a novel weakly supervised method for pixel-level segmentation in histopathology images, which introduces Transformer into the MIL framework to capture global or long-range dependencies. The multi-head self-attention in the Transformer establishes the relationship between instances, which solves the shortcoming that instances are independent of each other in MIL. In addition, deep supervision is introduced to overcome the limitation of annotations in weakly supervised methods and make the better utilization of hierarchical information. The state-of-the-art results on the colon cancer dataset demonstrate the superiority of the proposed method compared with other weakly supervised methods. It is worth believing that there is a potential of our approach for various applications in medical images.
Code (1)
Tasks
Image SegmentationMultiple Instance LearningSegmentationSemantic SegmentationWeakly-supervised LearningWeakly supervised segmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
CAMEL: A Weakly Supervised Learning Framework for Histopathology Image Segmentation
Histopathology image analysis plays a critical role in cancer diagnosis and treatment. To automatically segment the cancerous regions, fully supervised segmentation algorithms require labor-intensive and time-consuming l…
Image SegmentationMultiple Instance LearningSegmentationSemantic Segmentation+1Constrained Deep Weak Supervision for Histopathology Image Segmentation
In this paper, we develop a new weakly-supervised learning algorithm to learn to segment cancerous regions in histopathology images. Our work is under a multiple instance learning framework (MIL) with a new formulation, …
Image SegmentationMultiple Instance LearningSemantic SegmentationWeakly-supervised LearningWeakly Supervised Contrastive Learning for Histopathology Patch Embeddings
Digital histopathology whole slide images (WSIs) provide gigapixel-scale high-resolution images that are highly useful for disease diagnosis. However, digital histopathology image analysis faces significant challenges du…
Multiple Instance LearningRepresentation LearningContrastive LearningIntegrative Graph-Transformer Framework for Histopathology Whole Slide Image Representation and Classification
In digital pathology, the multiple instance learning (MIL) strategy is widely used in the weakly supervised histopathology whole slide image (WSI) classification task where giga-pixel WSIs are only labeled at the slide l…
Multiple Instance LearningWeakly-Supervised Deep Learning Model for Prostate Cancer Diagnosis and Gleason Grading of Histopathology Images
Prostate cancer is the most common cancer in men worldwide and the second leading cause of cancer death in the United States. One of the prognostic features in prostate cancer is the Gleason grading of histopathology ima…
Multiple Instance Learningwhole slide images