paper-with-me

홈 › Papers

A General-Purpose Self-Supervised Model for Computational Pathology

2023-08-29 · Richard J. Chen, Tong Ding, Ming Y. Lu, Drew F. K. Williamson, Guillaume Jaume, Bowen Chen, Andrew Zhang, Daniel Shao, Andrew H. Song, Muhammad Shaban, Mane Williams, Anurag Vaidya, Sharifa Sahai, Lukas Oldenburg, Luca L. Weishaupt, Judy J. Wang, Walt Williams, Long Phi Le, Georg Gerber, Faisal Mahmood

Tissue phenotyping is a fundamental computational pathology (CPath) task in learning objective characterizations of histopathologic biomarkers in anatomic pathology. However, whole-slide imaging (WSI) poses a complex computer vision problem in which the large-scale image resolutions of WSIs and the enormous diversity of morphological phenotypes preclude large-scale data annotation. Current efforts have proposed using pretrained image encoders with either transfer learning from natural image datasets or self-supervised pretraining on publicly-available histopathology datasets, but have not been extensively developed and evaluated across diverse tissue types at scale. We introduce UNI, a general-purpose self-supervised model for pathology, pretrained using over 100 million tissue patches from over 100,000 diagnostic haematoxylin and eosin-stained WSIs across 20 major tissue types, and evaluated on 33 representative CPath clinical tasks in CPath of varying diagnostic difficulties. In addition to outperforming previous state-of-the-art models, we demonstrate new modeling capabilities in CPath such as resolution-agnostic tissue classification, slide classification using few-shot class prototypes, and disease subtyping generalization in classifying up to 108 cancer types in the OncoTree code classification system. UNI advances unsupervised representation learning at scale in CPath in terms of both pretraining data and downstream evaluation, enabling data-efficient AI models that can generalize and transfer to a gamut of diagnostically-challenging tasks and clinical workflows in anatomic pathology.

📄 PDF Abstract BibTeX arXiv:2308.15474

Code (1)

kaiko-ai/eva pytorch

Tasks

Code ClassificationDiagnosticRepresentation LearningTransfer Learning

Similar Papers 제목 키워드 기반

Multimodal Whole Slide Foundation Model for Pathology

2024-11-29 · Tong Ding, Sophia J. Wagner, Andrew H. Song, Richard J. Chen 외

The field of computational pathology has been transformed with recent advances in foundation models that encode histopathology region-of-interests (ROIs) into versatile and transferable feature representations via self-s…

Cross-Modal RetrievalmodelPrognosisRetrieval+3

Foundation Models in Computational Pathology: A Review of Challenges, Opportunities, and Impact

2025-02-12 · Mohsin Bilal, Aadam, Manahil Raza, Youssef Altherwy 외

From self-supervised, vision-only models to contrastive visual-language frameworks, computational pathology has rapidly evolved in recent years. Generative AI "co-pilots" now demonstrate the ability to mine subtle, sub-v…

Misconceptions

A Foundational Multimodal Vision Language AI Assistant for Human Pathology

2023-12-13 · Ming Y. Lu, Bowen Chen, Drew F. K. Williamson, Richard J. Chen 외

The field of computational pathology has witnessed remarkable progress in the development of both task-specific predictive models and task-agnostic self-supervised vision encoders. However, despite the explosive growth o…

Decision MakingDiagnosticLanguage ModellingLarge Language Model+1

Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Images

2020-04-20 · Ming Y. Lu, Drew F. K. Williamson, Tiffany Y. Chen, Richard J. Chen 외

The rapidly emerging field of computational pathology has the potential to enable objective diagnosis, therapeutic response prediction and identification of new morphological features of clinical relevance. However, deep…

ClusteringDiagnosticDomain AdaptationMultiple Instance Learning+2

Self-Path: Self-supervision for Classification of Pathology Images with Limited Annotations

2020-08-12 · Navid Alemi Koohbanani, Balagopal Unnikrishnan, Syed Ali Khurram, Pavitra Krishnaswamy 외

While high-resolution pathology images lend themselves well to `data hungry' deep learning algorithms, obtaining exhaustive annotations on these images is a major challenge. In this paper, we propose a self-supervised CN…

Domain AdaptationGeneral ClassificationMulti-Task Learning