End-to-end Multiple Instance Learning for Whole-Slide Cytopathology of Urothelial Carcinoma
As a non-invasive approach, cytopathology of urine sediment is a highly promising approach to diagnosing urothelial carcinoma. However, computational assessment of the cytopathological status of a sample raises the challenge of identifying few cancerous cells among thousands of cells in a microscopic whole-slide image. To address this challenge, we propose an end-to-end trainable multiple instance learning approach that combines the attention mechanism and hard negative mining to classify hematoxylin and eosin stained patient-level whole-slide images of urine sediment cells. The singular cells are extracted by a simple foreground detection algorithm. With feature embeddings computed for each image patch in a bag by a convolutional neural network, the attention mechanism serves as the pooling operator, enabling a bag-level prediction while still giving an interpretable score for each image patch. This enables the identification of key instances and potential regions of interest that trigger a patient-level decision. Our results show that the proposed system can differentiate between normal and cancerous urothelial cells, thus enabling the non-invasive diagnosis of urothelial carcinoma in patients using urine sediment analysis.
Code (1)
Tasks
Multiple Instance Learningwhole slide imagesSimilar Papers 제목 키워드 기반
Weakly Supervised Instance Learning for Thyroid Malignancy Prediction from Whole Slide Cytopathology Images
We consider machine-learning-based thyroid-malignancy prediction from cytopathology whole-slide images (WSI). Multiple instance learning (MIL) approaches, typically used for the analysis of WSIs, divide the image (bag) i…
DiagnosticInformativenessMultiple Instance LearningTwo-sample testing+1Thyroid Cancer Malignancy Prediction From Whole Slide Cytopathology Images
We consider preoperative prediction of thyroid cancer based on ultra-high-resolution whole-slide cytopathology images. Inspired by how human experts perform diagnosis, our approach first identifies and classifies diagnos…
DiagnosticMultiple Instance LearningPredictionAn efficient framework based on large foundation model for cervical cytopathology whole slide image screening
Current cervical cytopathology whole slide image (WSI) screening primarily relies on detection-based approaches, which are limited in performance due to the expense and time-consuming annotation process. Multiple Instanc…
Contrastive LearningMultiple Instance Learningparameter-efficient fine-tuningSelf-Supervised Learning+1Automated Quality Evaluation of Cervical Cytopathology Whole Slide Images Based on Content Analysis
The ThinPrep Cytologic Test (TCT) is the most widely used method for cervical cancer screening, and the sample quality directly impacts the accuracy of the diagnosis. Traditional manual evaluation methods rely on the obs…
Diagnosticobject-detectionObject Detectionwhole slide imagesSparseConvMIL: Sparse Convolutional Context-Aware Multiple Instance Learning for Whole Slide Image Classification
Multiple instance learning (MIL) is the preferred approach for whole slide image classification. However, most MIL approaches do not exploit the interdependencies of tiles extracted from a whole slide image, which could …
Classificationimage-classificationImage ClassificationMultiple Instance Learning+2