paper-with-me

Papers

Human-machine Interactive Tissue Prototype Learning for Label-efficient Histopathology Image Segmentation

2022-11-26 · Wentao Pan, Jiangpeng Yan, Hanbo Chen, Jiawei Yang, Zhe Xu, Xiu Li, Jianhua Yao

Recently, deep neural networks have greatly advanced histopathology image segmentation but usually require abundant annotated data. However, due to the gigapixel scale of whole slide images and pathologists' heavy daily workload, obtaining pixel-level labels for supervised learning in clinical practice is often infeasible. Alternatively, weakly-supervised segmentation methods have been explored with less laborious image-level labels, but their performance is unsatisfactory due to the lack of dense supervision. Inspired by the recent success of self-supervised learning methods, we present a label-efficient tissue prototype dictionary building pipeline and propose to use the obtained prototypes to guide histopathology image segmentation. Particularly, taking advantage of self-supervised contrastive learning, an encoder is trained to project the unlabeled histopathology image patches into a discriminative embedding space where these patches are clustered to identify the tissue prototypes by efficient pathologists' visual examination. Then, the encoder is used to map the images into the embedding space and generate pixel-level pseudo tissue masks by querying the tissue prototype dictionary. Finally, the pseudo masks are used to train a segmentation network with dense supervision for better performance. Experiments on two public datasets demonstrate that our human-machine interactive tissue prototype learning method can achieve comparable segmentation performance as the fully-supervised baselines with less annotation burden and outperform other weakly-supervised methods. Codes will be available upon publication.

📄 PDF Abstract BibTeX arXiv:2211.14491

Code (1)

winterpan2017/proto2seg 공식 구현 pytorch

Tasks

Contrastive LearningImage SegmentationSegmentationSelf-Supervised LearningSemantic SegmentationWeakly supervised segmentationwhole slide images

Similar Papers 제목 키워드 기반

But that's not why: Inference adjustment by interactive prototype revision

2022-03-18 · Michael Gerstenberger, Sebastian Lapuschkin, Peter Eisert, Sebastian Bosse

Despite significant advances in machine learning, decision-making of artificial agents is still not perfect and often requires post-hoc human interventions. If the prediction of a model relies on unreasonable factors it …

BIG-bench Machine LearningDecision Making

Towards Involving End-users in Interactive Human-in-the-loop AI Fairness

2022-04-22 · Yuri Nakao, Simone Stumpf, Subeida Ahmed, Aisha Naseer 외

Ensuring fairness in artificial intelligence (AI) is important to counteract bias and discrimination in far-reaching applications. Recent work has started to investigate how humans judge fairness and how to support machi…

BIG-bench Machine LearningExplainable Artificial Intelligence (XAI)Fairness

Interactive Disentanglement: Learning Concepts by Interacting with their Prototype Representations

2021-12-04 · CVPR 2022 1 · Wolfgang Stammer, Marius Memmel, Patrick Schramowski, Kristian Kersting

Learning visual concepts from raw images without strong supervision is a challenging task. In this work, we show the advantages of prototype representations for understanding and revising the latent space of neural conce…

Disentanglement

Toward Machine-Guided, Human-Initiated Explanatory Interactive Learning

2020-07-20 · Teodora Popordanoska, Mohit Kumar, Stefano Teso

Recent work has demonstrated the promise of combining local explanations with active learning for understanding and supervising black-box models. Here we show that, under specific conditions, these algorithms may misrepr…

Active LearningClustering

GRAPE: Graph-Augmented Prototype Explanations for Interactive Medical Image Diagnosis

2026-06-29 · Rasul Khanbayov, Erchin Serpedin, Hasan Kurban arxiv

Prototype-based medical image classifiers present three clinical limitations: they treat findings as independent, silently amplify unsafe physician feedback, and require full retraining whenever a new finding is needed. …