A Deep Reinforcement Learning Framework for Rapid Diagnosis of Whole Slide Pathological Images
The deep neural network is a research hotspot for histopathological image analysis, which can improve the efficiency and accuracy of diagnosis for pathologists or be used for disease screening. The whole slide pathological image can reach one gigapixel and contains abundant tissue feature information, which needs to be divided into a lot of patches in the training and inference stages. This will lead to a long convergence time and large memory consumption. Furthermore, well-annotated data sets are also in short supply in the field of digital pathology. Inspired by the pathologist's clinical diagnosis process, we propose a weakly supervised deep reinforcement learning framework, which can greatly reduce the time required for network inference. We use neural network to construct the search model and decision model of reinforcement learning agent respectively. The search model predicts the next action through the image features of different magnifications in the current field of view, and the decision model is used to return the predicted probability of the current field of view image. In addition, an expert-guided model is constructed by multi-instance learning, which not only provides rewards for search model, but also guides decision model learning by the knowledge distillation method. Experimental results show that our proposed method can achieve fast inference and accurate prediction of whole slide images without any pixel-level annotations.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningKnowledge Distillationreinforcement-learningReinforcement Learning (RL)whole slide imagesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
OpenSRH: optimizing brain tumor surgery using intraoperative stimulated Raman histology
Accurate intraoperative diagnosis is essential for providing safe and effective care during brain tumor surgery. Our standard-of-care diagnostic methods are time, resource, and labor intensive, which restricts access to …
Brain Tumor ClassificationDiagnosticRepresentation LearningA Deep Learning based Pipeline for Efficient Oral Cancer Screening on Whole Slide Images
Oral cancer incidence is rapidly increasing worldwide. The most important determinant factor in cancer survival is early diagnosis. To facilitate large scale screening, we propose a fully automated pipeline for oral canc…
Cancer ClassificationClassificationGeneral ClassificationOral Cancer Classification+2Lifelong Whole Slide Image Analysis: Online Vision-Language Adaptation and Past-to-Present Gradient Distillation
Whole Slide Images (WSIs) play a crucial role in accurate cancer diagnosis and prognosis, as they provide tissue details at the cellular level. However, the rapid growth of computational tasks involving WSIs poses signif…
class-incremental learningClass Incremental LearningContinual LearningIncremental Learning+3RMDL: Recalibrated multi-instance deep learning for whole slide gastric image classification
The whole slide histopathology images (WSIs) play a critical role in gastric cancer diagnosis. However, due to the large scale of WSIs and various sizes of the abnormal area, how to select informative regions and analyze…
General Classificationimage-classificationImage ClassificationA Precision Diagnostic Framework of Renal Cell Carcinoma on Whole-Slide Images using Deep Learning
Diagnostic pathology, which is the basis and gold standard of cancer diagnosis, provides essential information on the prognosis of the disease and vital evidence for clinical treatment. Tumor region detection, subtype an…
ClassificationDiagnosticPrognosiswhole slide images