paper-with-me

Papers

Promptable Representation Distribution Learning and Data Augmentation for Gigapixel Histopathology WSI Analysis

2024-12-19 · Kunming Tang, Zhiguo Jiang, Jun Shi, Wei Wang, Haibo Wu, Yushan Zheng

Gigapixel image analysis, particularly for whole slide images (WSIs), often relies on multiple instance learning (MIL). Under the paradigm of MIL, patch image representations are extracted and then fixed during the training of the MIL classifiers for efficiency consideration. However, the invariance of representations makes it difficult to perform data augmentation for WSI-level model training, which significantly limits the performance of the downstream WSI analysis. The current data augmentation methods for gigapixel images either introduce additional computational costs or result in a loss of semantic information, which is hard to meet the requirements for efficiency and stability needed for WSI model training. In this paper, we propose a Promptable Representation Distribution Learning framework (PRDL) for both patch-level representation learning and WSI-level data augmentation. Meanwhile, we explore the use of prompts to guide data augmentation in feature space, which achieves promptable data augmentation for training robust WSI-level models. The experimental results have demonstrated that the proposed method stably outperforms state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2412.14473

Code (1)

lazytkm/prdl 공식 구현 pytorch

Tasks

Data AugmentationMultiple Instance LearningRepresentation Learningwhole slide images

Similar Papers 제목 키워드 기반

TSMS-SAM2: Multi-scale Temporal Sampling Augmentation and Memory-Splitting Pruning for Promptable Video Object Segmentation and Tracking in Surgical Scenarios

2025-08-07 · Guoping Xu, Hua-Chieh Shao, You Zhang arxiv

Promptable video object segmentation and tracking (VOST) has seen significant advances with the emergence of foundation models like Segment Anything Model 2 (SAM2); however, their application in surgical video analysis r…

Video Object Segmentation

LSA: Latent Style Augmentation Towards Stain-Agnostic Cervical Cancer Screening

2025-03-09 · Jiangdong Cai, Haotian Jiang, Zhenrong Shen, Yonghao Li 외

The deployment of computer-aided diagnosis systems for cervical cancer screening using whole slide images (WSIs) faces critical challenges due to domain shifts caused by staining variations across different scanners and …

whole slide images

When an Image is Worth 1,024 x 1,024 Words: A Case Study in Computational Pathology

2023-12-06 · Wenhui Wang, Shuming Ma, Hanwen Xu, Naoto Usuyama 외

This technical report presents LongViT, a vision Transformer that can process gigapixel images in an end-to-end manner. Specifically, we split the gigapixel image into a sequence of millions of patches and project them l…

PrognosisSurvival Predictionwhole slide images

Embedding Space Augmentation for Weakly Supervised Learning in Whole-Slide Images

2022-10-31 · Imaad Zaffar, Guillaume Jaume, Nasir Rajpoot, Faisal Mahmood

Multiple Instance Learning (MIL) is a widely employed framework for learning on gigapixel whole-slide images (WSIs) from WSI-level annotations. In most MIL based analytical pipelines for WSI-level analysis, the WSIs are …

Data AugmentationGenerative Adversarial NetworkMultiple Instance LearningWeakly-supervised Learning+1

CLIP meets Model Zoo Experts: Pseudo-Supervision for Visual Enhancement

2023-10-21 · Mohammadreza Salehi, Mehrdad Farajtabar, Maxwell Horton, Fartash Faghri 외

Contrastive language image pretraining (CLIP) is a standard method for training vision-language models. While CLIP is scalable, promptable, and robust to distribution shifts on image classification tasks, it lacks object…

Depth Estimationimage-classificationImage ClassificationObject Localization+3