paper-with-me

Papers

Promptable cancer segmentation using minimal expert-curated data

2025-05-23 · Lynn Karam, Yipei Wang, Veeru Kasivisvanathan, Mirabela Rusu, Yipeng Hu, Shaheer U. Saeed

Automated segmentation of cancer on medical images can aid targeted diagnostic and therapeutic procedures. However, its adoption is limited by the high cost of expert annotations required for training and inter-observer variability in datasets. While weakly-supervised methods mitigate some challenges, using binary histology labels for training as opposed to requiring full segmentation, they require large paired datasets of histology and images, which are difficult to curate. Similarly, promptable segmentation aims to allow segmentation with no re-training for new tasks at inference, however, existing models perform poorly on pathological regions, again necessitating large datasets for training. In this work we propose a novel approach for promptable segmentation requiring only 24 fully-segmented images, supplemented by 8 weakly-labelled images, for training. Curating this minimal data to a high standard is relatively feasible and thus issues with the cost and variability of obtaining labels can be mitigated. By leveraging two classifiers, one weakly-supervised and one fully-supervised, our method refines segmentation through a guided search process initiated by a single-point prompt. Our approach outperforms existing promptable segmentation methods, and performs comparably with fully-supervised methods, for the task of prostate cancer segmentation, while using substantially less annotated data (up to 100X less). This enables promptable segmentation with very minimal labelled data, such that the labels can be curated to a very high standard.

📄 PDF Abstract BibTeX arXiv:2505.17915

Code (1)

lynnkaram/promptable-cancer-segmentation 공식 구현 tf

Tasks

DiagnosticSegmentation

Similar Papers 제목 키워드 기반

Promptable segmentation with region exploration enables minimal-effort expert-level prostate cancer delineation

2026-02-19 · Junqing Yang, Natasha Thorley, Ahmed Nadeem Abbasi, Shonit Punwani 외 arxiv

Purpose: Accurate segmentation of prostate cancer on magnetic resonance (MR) images is crucial for planning image-guided interventions such as targeted biopsies, cryoablation, and radiotherapy. However, subtle and variab…

Reinforcement Learning

CLIP meets Model Zoo Experts: Pseudo-Supervision for Visual Enhancement

2023-10-21 · Mohammadreza Salehi, Mehrdad Farajtabar, Maxwell Horton, Fartash Faghri 외

Contrastive language image pretraining (CLIP) is a standard method for training vision-language models. While CLIP is scalable, promptable, and robust to distribution shifts on image classification tasks, it lacks object…

Depth Estimationimage-classificationImage ClassificationObject Localization+3

Text Promptable Surgical Instrument Segmentation with Vision-Language Models

2023-06-15 · NeurIPS 2023 11

In this paper, we propose a novel text promptable surgical instrument segmentation approach to overcome challenges associated with diversity and differentiation of surgical instruments in minimally invasive surgeries. We…

DecoderDiversitySegmentation

A multi-centre polyp detection and segmentation dataset for generalisability assessment

2021-06-08 · Sharib Ali, Debesh Jha, Noha Ghatwary, Stefano Realdon 외

Polyps in the colon are widely known cancer precursors identified by colonoscopy. Whilst most polyps are benign, the polyp's number, size and surface structure are linked to the risk of colon cancer. Several methods have…

Medical Image Segmentation

BREPS: Bounding-Box Robustness Evaluation of Promptable Segmentation

2026-01-21 · Andrey Moskalenko, Danil Kuznetsov, Irina Dudko, Anastasiia Iasakova 외 arxiv

Promptable segmentation models such as SAM have established a powerful paradigm, enabling strong generalization to unseen objects and domains with minimal user input, including points, bounding boxes, and text prompts. A…