paper-with-me

Papers

Improving Tail-Class Representation with Centroid Contrastive Learning

2021-10-19 · Anthony Meng Huat Tiong, Junnan Li, Guosheng Lin, Boyang Li, Caiming Xiong, Steven C. H. Hoi

In vision domain, large-scale natural datasets typically exhibit long-tailed distribution which has large class imbalance between head and tail classes. This distribution poses difficulty in learning good representations for tail classes. Recent developments have shown good long-tailed model can be learnt by decoupling the training into representation learning and classifier balancing. However, these works pay insufficient consideration on the long-tailed effect on representation learning. In this work, we propose interpolative centroid contrastive learning (ICCL) to improve long-tailed representation learning. ICCL interpolates two images from a class-agnostic sampler and a class-aware sampler, and trains the model such that the representation of the interpolative image can be used to retrieve the centroids for both source classes. We demonstrate the effectiveness of our approach on multiple long-tailed image classification benchmarks. Our result shows a significant accuracy gain of 2.8% on the iNaturalist 2018 dataset with a real-world long-tailed distribution.

📄 PDF Abstract BibTeX arXiv:2110.10048

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive Learningimage-classificationImage ClassificationLong-tail LearningRepresentation Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Distribution-Aware Robust Learning from Long-Tailed Data with Noisy Labels

2024-07-23 · Jae Soon Baik, In Young Yoon, Kun Hoon Kim, Jun Won Choi

Deep neural networks have demonstrated remarkable advancements in various fields using large, well-annotated datasets. However, real-world data often exhibit long-tailed distributions and label noise, significantly degra…

Contrastive Learning

Multi-Centroid Representation Network for Domain Adaptive Person Re-ID

2021-12-22 · Yuhang Wu, Tengteng Huang, Haotian Yao, Chi Zhang 외

Recently, many approaches tackle the Unsupervised Domain Adaptive person re-identification (UDA re-ID) problem through pseudo-label-based contrastive learning. During training, a uni-centroid representation is obtained b…

Contrastive LearningDomain Adaptive Person Re-IdentificationPerson Re-IdentificationPseudo Label

Bootstrapping Contrastive Learning Enhanced Music Cold-Start Matching

2023-08-05 · Xinping Zhao, Ying Zhang, Qiang Xiao, Yuming Ren 외

We study a particular matching task we call Music Cold-Start Matching. In short, given a cold-start song request, we expect to retrieve songs with similar audiences and then fastly push the cold-start song to the audienc…

Contrastive LearningRepresentation Learning

The Cost of Language: Centroid Erasure Exposes and Exploits Modal Competition in Multimodal Language Models

2026-04-15 · Akshay Paruchuri, Ishan Chatterjee, Henry Fuchs, Ehsan Adeli 외 arxiv

Multimodal language models systematically underperform on visual perception tasks, yet the structure underlying this failure remains poorly understood. We propose centroid replacement, collapsing each token to its neares…

Visual Reasoning

All4One: Symbiotic Neighbour Contrastive Learning via Self-Attention and Redundancy Reduction

2023-03-16 · ICCV 2023 1 · Imanol G. Estepa, Ignacio Sarasúa, Bhalaji Nagarajan, Petia Radeva

Nearest neighbour based methods have proved to be one of the most successful self-supervised learning (SSL) approaches due to their high generalization capabilities. However, their computational efficiency decreases when…

Computational EfficiencyContrastive LearningSelf-Supervised Image ClassificationSelf-Supervised Learning