paper-with-me

Papers

Local Aggregation for Unsupervised Learning of Visual Embeddings

2019-03-29 · ICCV 2019 10 · Chengxu Zhuang, Alex Lin Zhai, Daniel Yamins

Unsupervised approaches to learning in neural networks are of substantial interest for furthering artificial intelligence, both because they would enable the training of networks without the need for large numbers of expensive annotations, and because they would be better models of the kind of general-purpose learning deployed by humans. However, unsupervised networks have long lagged behind the performance of their supervised counterparts, especially in the domain of large-scale visual recognition. Recent developments in training deep convolutional embeddings to maximize non-parametric instance separation and clustering objectives have shown promise in closing this gap. Here, we describe a method that trains an embedding function to maximize a metric of local aggregation, causing similar data instances to move together in the embedding space, while allowing dissimilar instances to separate. This aggregation metric is dynamic, allowing soft clusters of different scales to emerge. We evaluate our procedure on several large-scale visual recognition datasets, achieving state-of-the-art unsupervised transfer learning performance on object recognition in ImageNet, scene recognition in Places 205, and object detection in PASCAL VOC.

📄 PDF Abstract BibTeX arXiv:1903.12355

Code (1)

neuroailab/LocalAggregation-Pytorch pytorch

Tasks

ClusteringContrastive Learningobject-detectionObject DetectionObject RecognitionScene RecognitionSelf-Supervised Image ClassificationTransfer Learning

Similar Papers 제목 키워드 기반

Unsupervised Hierarchical Graph Representation Learning by Mutual Information Maximization

2020-03-18 · Fei Ding, Xiaohong Zhang, Justin Sybrandt, Ilya Safro

Graph representation learning based on graph neural networks (GNNs) can greatly improve the performance of downstream tasks, such as node and graph classification. However, the general GNN models do not aggregate node in…

General ClassificationGraph ClassificationGraph Representation LearningRepresentation Learning

Cross-Modal Prototype Allocation: Unsupervised Slide Representation Learning via Patch-Text Contrast in Computational Pathology

2025-03-26 · Yuxuan Chen, Jiawen Li, Jiali Hu, Xitong Ling 외

With the rapid advancement of pathology foundation models (FMs), the representation learning of whole slide images (WSIs) attracts increasing attention. Existing studies develop high-quality patch feature extractors and …

DescriptiveLarge Language ModelMultiple Instance LearningRepresentation Learning+1

LAVA: Explainability for Unsupervised Latent Embeddings

2025-09-25 · Ivan Stresec, Joana P. Gonçalves arxiv

Unsupervised black-box models are drivers of scientific discovery, yet are difficult to interpret, as their output is often a multidimensional embedding rather than a well-defined target. While explainability for supervi…

VGSE: Visually-Grounded Semantic Embeddings for Zero-Shot Learning

2022-03-20 · CVPR 2022 1 · Wenjia Xu, Yongqin Xian, Jiuniu Wang, Bernt Schiele 외

Human-annotated attributes serve as powerful semantic embeddings in zero-shot learning. However, their annotation process is labor-intensive and needs expert supervision. Current unsupervised semantic embeddings, i.e., w…

Transfer LearningWord EmbeddingsZero-Shot Learning

Secure Embedding Aggregation for Federated Representation Learning

2022-06-18 · Jiaxiang Tang, Jinbao Zhu, Songze Li, Lichao Sun

We consider a federated representation learning framework, where with the assistance of a central server, a group of $N$ distributed clients train collaboratively over their private data, for the representations (or embe…

Federated LearningPrivacy PreservingRepresentation Learning