paper-with-me

홈 › Papers

Towards Better Understanding and Better Generalization of Low-shot Classification in Histology Images with Contrastive Learning

2021-09-29 · ICLR 2022 4 · Jiawei Yang, Hanbo Chen, Jiangpeng Yan, Xiaoyu Chen, Jianhua Yao

Low-shot learning is an established topic in natural images for years, but few work is attended to histology images, which is of high clinical value since well-labeled datasets and rare abnormal samples are expensive to collect. Here, we pioneer the study of low-shot learning for histology images by setting up three cross-domain tasks that reflect real clinics problems. To enable label-efficient learning and better generalizability, we propose to incorporate contrastive learning (CL) with latent augmentation (LA) to build a few-shot system. CL learns useful representations without manual labels, while LA transfers semantic variations of base dataset in an unsupervised way. These two components fully exploit unlabeled training data and can scale gracefully to other label-hungry problems. In experiments, we find: i) models learned by CL generalize fairly better than supervised learning for histology images, and ii) LA brings consistent gains over baselines. Prior studies of self-supervised representation learning mainly focus on ImageNet-like images, which only present a dominant object in their centers. Recent attention has been paid to images with multi-objects and multi-textures (Chen & Li, 2020). Histology images are a natural choice for such study. We show the superiority of CL over supervised learning in terms of generalization for such data, and provide our empirical understanding for this observation. The findings in this work could contribute to understanding how model generalizes in the context of both self-supervised learning and histology images.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningRepresentation LearningSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Towards better understanding and better generalization of few-shot classification in histology images with contrastive learning

2022-02-18 · Jiawei Yang, Hanbo Chen, Jiangpeng Yan, Xiaoyu Chen 외

Few-shot learning is an established topic in natural images for years, but few work is attended to histology images, which is of high clinical value since well-labeled datasets and rare abnormal samples are expensive to …

Contrastive LearningFew-Shot LearningRepresentation LearningSelf-Supervised Learning

PerceptionCLIP: Visual Classification by Inferring and Conditioning on Contexts

2023-08-02 · Bang An, Sicheng Zhu, Michael-Andrei Panaitescu-Liess, Chaithanya Kumar Mummadi 외

Vision-language models like CLIP are widely used in zero-shot image classification due to their ability to understand various visual concepts and natural language descriptions. However, how to fully leverage CLIP's unpre…

Classificationimage-classificationImage ClassificationLanguage Modelling+4

Attentive Task-Agnostic Meta-Learning for Few-Shot Text Classification

2019-05-01 · ICLR 2019 5 · Xiang Jiang, Mohammad Havaei, Gabriel Chartrand, Hassan Chouaib 외

Current deep learning based text classification methods are limited by their ability to achieve fast learning and generalization when the data is scarce. We address this problem by integrating a meta-learning procedure t…

ClassificationFew-Shot Text ClassificationGeneral ClassificationInductive Bias+8

A Simple Meta-learning Paradigm for Zero-shot Intent Classification with Mixture Attention Mechanism

2022-06-05 · Han Liu, Siyang Zhao, Xiaotong Zhang, Feng Zhang 외

Zero-shot intent classification is a vital and challenging task in dialogue systems, which aims to deal with numerous fast-emerging unacquainted intents without annotated training data. To obtain more satisfactory perfor…

Classificationintent-classificationIntent ClassificationMeta-Learning+3

Unraveling Meta-Learning: Understanding Feature Representations for Few-Shot Tasks

2020-02-17 · ICML 2020 1 · Micah Goldblum, Steven Reich, Liam Fowl, Renkun Ni 외

Meta-learning algorithms produce feature extractors which achieve state-of-the-art performance on few-shot classification. While the literature is rich with meta-learning methods, little is known about why the resulting …

ClassificationGeneral ClassificationMeta-Learning