LanGuSTE: Language-Guided Coarse-to-Fine Patch Selection for Efficient Whole Slide Image Analysis
Whole slide images (WSIs) in computational pathology pose a major computational challenge due to their gigapixel scale, often requiring tens to hundreds of thousands of high-resolution patches to be processed per slide. In conventional WSI pipelines, exhaustive high-resolution patch processing makes preprocessing far more time-consuming than downstream model training. Existing patch selection methods suffer from a fundamental paradox: all patches must still be extracted and encoded at least during training, and sometimes during both training and inference, before irrelevant ones can be discarded. To address this, we propose LanGuSTE, an efficient patch selection framework that integrates pathology-domain vision-language models (VLMs) and knowledge derived from large language models (LLMs) through two key modules: Cross- Scale Visual Prompt Tuning (CS-VPT) and coarse-to-fine patch selection. CS-VPT aligns low-resolution patches with their spatially corresponding high-resolution patches through contrastive learning, transferring fine-grained diagnostic semantics into low-resolution representations. The patch selection module then leverages VLM representations and LLM-generated pathology-specific descriptions to identify informative regions in a coarse-to-fine manner, encoding only the corresponding high-resolution patches to reduce preprocessing time. Extensive experiments demonstrate that LanGuSTE reduces overall WSI processing time to approximately 3x while achieving diagnostic performance comparable to or better than exhaustive patch processing and recent state-of-the-art patch-selection methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge DistillationSimilar Papers 제목 키워드 기반
EDGER: EDge-Guided with HEatmap Refinement for Generalizable Image Forgery Localization
Text-guided inpainting has made image forgery increasingly realistic, challenging both SID and IFL. However, existing methods often struggle to point out suspicious signals across domains. To address this problem, we pro…
Domain GeneralizationCoFiNet: Reliable Coarse-to-fine Correspondences for Robust PointCloud Registration
We study the problem of extracting correspondences between a pair of point clouds for registration. For correspondence retrieval, existing works benefit from matching sparse keypoints detected from dense points but usual…
Keypoint DetectionPoint Cloud RegistrationRetrievalCoFiNet: Reliable Coarse-to-fine Correspondences for Robust Point Cloud Registration
We study the problem of extracting correspondences between a pair of point clouds for registration. For correspondence retrieval, existing works benefit from matching sparse keypoints detected from dense points but usual…
Keypoint DetectionPoint Cloud RegistrationRetrievalDual-Resolution Correspondence Networks
We tackle the problem of establishing dense pixel-wise correspondences between a pair of images. In this work, we introduce Dual-Resolution Correspondence Networks (DualRC-Net), to obtain pixel-wise correspondences in a …
Coarse-to-Fine Learning for Multi-Pipette Localisation in Robot-Assisted In Vivo Patch-Clamp
In vivo image-guided multi-pipette patch-clamp is essential for studying cellular interactions and network dynamics in neuroscience. However, current procedures mainly rely on manual expertise, which limits accessibility…
Generative Adversarial Network