paper-with-me

홈 › Papers

Towards better understanding and better generalization of few-shot classification in histology images with contrastive learning

2022-02-18 · Jiawei Yang, Hanbo Chen, Jiangpeng Yan, Xiaoyu Chen, Jianhua Yao

Few-shot learning is an established topic in natural images for years, but few work is attended to histology images, which is of high clinical value since well-labeled datasets and rare abnormal samples are expensive to collect. Here, we facilitate the study of few-shot learning in histology images by setting up three cross-domain tasks that simulate real clinics problems. To enable label-efficient learning and better generalizability, we propose to incorporate contrastive learning (CL) with latent augmentation (LA) to build a few-shot system. CL learns useful representations without manual labels, while LA transfers semantic variations of the base dataset in an unsupervised way. These two components fully exploit unlabeled training data and can scale gracefully to other label-hungry problems. In experiments, we find i) models learned by CL generalize better than supervised learning for histology images in unseen classes, and ii) LA brings consistent gains over baselines. Prior studies of self-supervised learning mainly focus on ImageNet-like images, which only present a dominant object in their centers. Recent attention has been paid to images with multi-objects and multi-textures. Histology images are a natural choice for such a study. We show the superiority of CL over supervised learning in terms of generalization for such data and provide our empirical understanding for this observation. The findings in this work could contribute to understanding how the model generalizes in the context of both representation learning and histological image analysis. Code is available.

📄 PDF Abstract BibTeX arXiv:2202.09059

Code (1)

TencentAILabHealthcare/Few-shot-WSI 공식 구현 pytorch

Tasks

Contrastive LearningFew-Shot LearningRepresentation LearningSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음
BASE 설명 없음

Similar Papers 제목 키워드 기반

Towards Better Understanding and Better Generalization of Low-shot Classification in Histology Images with Contrastive Learning

2021-09-29 · ICLR 2022 4 · Jiawei Yang, Hanbo Chen, Jiangpeng Yan, Xiaoyu Chen 외

Low-shot learning is an established topic in natural images for years, but few work is attended to histology images, which is of high clinical value since well-labeled datasets and rare abnormal samples are expensive to …

Contrastive LearningRepresentation LearningSelf-Supervised Learning

PerceptionCLIP: Visual Classification by Inferring and Conditioning on Contexts

2023-08-02 · Bang An, Sicheng Zhu, Michael-Andrei Panaitescu-Liess, Chaithanya Kumar Mummadi 외

Vision-language models like CLIP are widely used in zero-shot image classification due to their ability to understand various visual concepts and natural language descriptions. However, how to fully leverage CLIP's unpre…

Classificationimage-classificationImage ClassificationLanguage Modelling+4

Attentive Task-Agnostic Meta-Learning for Few-Shot Text Classification

2019-05-01 · ICLR 2019 5 · Xiang Jiang, Mohammad Havaei, Gabriel Chartrand, Hassan Chouaib 외

Current deep learning based text classification methods are limited by their ability to achieve fast learning and generalization when the data is scarce. We address this problem by integrating a meta-learning procedure t…

ClassificationFew-Shot Text ClassificationGeneral ClassificationInductive Bias+8

A Simple Meta-learning Paradigm for Zero-shot Intent Classification with Mixture Attention Mechanism

2022-06-05 · Han Liu, Siyang Zhao, Xiaotong Zhang, Feng Zhang 외

Zero-shot intent classification is a vital and challenging task in dialogue systems, which aims to deal with numerous fast-emerging unacquainted intents without annotated training data. To obtain more satisfactory perfor…

Classificationintent-classificationIntent ClassificationMeta-Learning+3

Unraveling Meta-Learning: Understanding Feature Representations for Few-Shot Tasks

2020-02-17 · ICML 2020 1 · Micah Goldblum, Steven Reich, Liam Fowl, Renkun Ni 외

Meta-learning algorithms produce feature extractors which achieve state-of-the-art performance on few-shot classification. While the literature is rich with meta-learning methods, little is known about why the resulting …

ClassificationGeneral ClassificationMeta-Learning