paper-with-me

Papers

Parametric Instance Classification for Unsupervised Visual Feature Learning

2020-06-25 · NeurIPS 2020 12 · Yue Cao, Zhenda Xie, Bin Liu, Yutong Lin, Zheng Zhang, Han Hu

This paper presents parametric instance classification (PIC) for unsupervised visual feature learning. Unlike the state-of-the-art approaches which do instance discrimination in a dual-branch non-parametric fashion, PIC directly performs a one-branch parametric instance classification, revealing a simple framework similar to supervised classification and without the need to address the information leakage issue. We show that the simple PIC framework can be as effective as the state-of-the-art approaches, i.e. SimCLR and MoCo v2, by adapting several common component settings used in the state-of-the-art approaches. We also propose two novel techniques to further improve effectiveness and practicality of PIC: 1) a sliding-window data scheduler, instead of the previous epoch-based data scheduler, which addresses the extremely infrequent instance visiting issue in PIC and improves the effectiveness; 2) a negative sampling and weight update correction approach to reduce the training time and GPU memory consumption, which also enables application of PIC to almost unlimited training images. We hope that the PIC framework can serve as a simple baseline to facilitate future study.

📄 PDF Abstract BibTeX arXiv:2006.14618

Code (1)

bl0/pic pytorch

Tasks

ClassificationGeneral ClassificationGPU

Methods 이 논문이 사용한 방법론

1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Residual Connection 설명 없음
Bottleneck Residual Block A Bottleneck Residual Block is a variant of the residual block that utilises 1x1 convolutions to create a bottleneck. The…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Residual Block Residual Blocks are skip-connection blocks that learn residual functions with reference to the layer inputs, instead of learning unreferenced functions. They were introduced…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Kaiming Initialization 설명 없음
Average Pooling 설명 없음

Similar Papers 제목 키워드 기반

Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination

2018-05-05 · Zhirong Wu, Yuanjun Xiong, Stella Yu, Dahua Lin

Neural net classifiers trained on data with annotated class labels can also capture apparent visual similarity among categories without being directed to do so. We study whether this observation can be extended beyond th…

Contrastive LearningGeneral Classificationobject-detectionObject Detection+1

Train a One-Million-Way Instance Classifier for Unsupervised Visual Representation Learning

2021-02-09 · Yu Liu, Lianghua Huang, Pan Pan, Bin Wang 외

This paper presents a simple unsupervised visual representation learning method with a pretext task of discriminating all images in a dataset using a parametric, instance-level classifier. The overall framework is a repl…

ClassificationGeneral ClassificationLinear evaluationRepresentation Learning

Unsupervised Feature Learning via Non-Parametric Instance Discrimination

2018-06-01 · CVPR 2018 6 · Zhirong Wu, Yuanjun Xiong, Stella X. Yu, Dahua Lin

Neural net classifiers trained on data with annotated class labels can also capture apparent visual similarity among categories without being directed to do so. We study whether this observation can be extended beyond th…

General Classificationobject-detectionObject DetectionRetrieval+2

Unsupervised deep learning for grading of age-related macular degeneration using retinal fundus images

2020-10-22 · Baladitya Yellapragada, Sascha Hornhauer, Kiersten Snyder, Stella Yu 외

Many diseases are classified based on human-defined rubrics that are prone to bias. Supervised neural networks can automate the grading of retinal fundus images, but require labor-intensive annotations and are restricted…

Local Aggregation for Unsupervised Learning of Visual Embeddings

2019-03-29 · ICCV 2019 10 · Chengxu Zhuang, Alex Lin Zhai, Daniel Yamins

Unsupervised approaches to learning in neural networks are of substantial interest for furthering artificial intelligence, both because they would enable the training of networks without the need for large numbers of exp…

ClusteringContrastive Learningobject-detectionObject Detection+4