Lifelong Histopathology Whole Slide Image Retrieval via Distance Consistency Rehearsal
Content-based histopathological image retrieval (CBHIR) has gained attention in recent years, offering the capability to return histopathology images that are content-wise similar to the query one from an established database. However, in clinical practice, the continuously expanding size of WSI databases limits the practical application of the current CBHIR methods. In this paper, we propose a Lifelong Whole Slide Retrieval (LWSR) framework to address the challenges of catastrophic forgetting by progressive model updating on continuously growing retrieval database. Our framework aims to achieve the balance between stability and plasticity during continuous learning. To preserve system plasticity, we utilize local memory bank with reservoir sampling method to save instances, which can comprehensively encompass the feature spaces of both old and new tasks. Furthermore, A distance consistency rehearsal (DCR) module is designed to ensure the retrieval queue's consistency for previous tasks, which is regarded as stability within a lifelong CBHIR system. We evaluated the proposed method on four public WSI datasets from TCGA projects. The experimental results have demonstrated the proposed method is effective and is superior to the state-of-the-art methods.
Code (1)
Tasks
Image RetrievalRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Zero-Shot Whole Slide Image Retrieval in Histopathology Using Embeddings of Foundation Models
We have tested recently published foundation models for histopathology for image retrieval. We report macro average of F1 score for top-1 retrieval, majority of top-3 retrievals, and majority of top-5 retrievals. We perf…
DiagnosticImage RetrievalRetrievalEvaluating and interpreting caption prediction for histopathology images
The automatic generation of captions from medical images can provide for an efficient way to annotate histopathology images with natural language descriptions. Such large-scale annotation of medical images may help facil…
Caption GenerationImage CaptioningImage RetrievalPrediction+2Ink removal from histopathology whole slide images by combining classification, detection and image generation models
Histopathology slides are routinely marked by pathologists using permanent ink markers that should not be removed as they form part of the medical record. Often tumour regions are marked up for the purpose of highlightin…
General ClassificationImage Generationwhole slide imagesSlideflow: Deep Learning for Digital Histopathology with Real-Time Whole-Slide Visualization
Deep learning methods have emerged as powerful tools for analyzing histopathological images, but current methods are often specialized for specific domains and software environments, and few open-source options exist for…
Deep LearningHistopathological Image ClassificationHistopathological SegmentationImage Generation+4Adversarial Domain Adaptation for Classification of Prostate Histopathology Whole-Slide Images
Automatic and accurate Gleason grading of histopathology tissue slides is crucial for prostate cancer diagnosis, treatment, and prognosis. Usually, histopathology tissue slides from different institutions show heterogene…
Domain AdaptationGeneral ClassificationPrognosisUnsupervised Domain Adaptation+1