paper-with-me

홈 › Papers

Frequency-Aware Self-Supervised Long-Tailed Learning

2023-09-09 · Ci-Siang Lin, Min-Hung Chen, Yu-Chiang Frank Wang

Data collected from the real world typically exhibit long-tailed distributions, where frequent classes contain abundant data while rare ones have only a limited number of samples. While existing supervised learning approaches have been proposed to tackle such data imbalance, the requirement of label supervision would limit their applicability to real-world scenarios in which label annotation might not be available. Without the access to class labels nor the associated class frequencies, we propose Frequency-Aware Self-Supervised Learning (FASSL) in this paper. Targeting at learning from unlabeled data with inherent long-tailed distributions, the goal of FASSL is to produce discriminative feature representations for downstream classification tasks. In FASSL, we first learn frequency-aware prototypes, reflecting the associated long-tailed distribution. Particularly focusing on rare-class samples, the relationships between image data and the derived prototypes are further exploited with the introduced self-supervised learning scheme. Experiments on long-tailed image datasets quantitatively and qualitatively verify the effectiveness of our learning scheme.

📄 PDF Abstract BibTeX arXiv:2309.04723

Code (0)

등록된 구현이 없습니다.

Tasks

Self-Supervised Learning

Similar Papers 제목 키워드 기반

WIA-LD2ND: Wavelet-based Image Alignment for Self-supervised Low-Dose CT Denoising

2024-03-18 · Haoyu Zhao, Yuliang Gu, Zhou Zhao, Bo Du 외

In clinical examinations and diagnoses, low-dose computed tomography (LDCT) is crucial for minimizing health risks compared with normal-dose computed tomography (NDCT). However, reducing the radiation dose compromises th…

DenoisingImage Denoising

Dataset Awareness is not Enough: Implementing Sample-level Tail Encouragement in Long-tailed Self-supervised Learning

2024-10-30 · Haowen Xiao, Guanghui Liu, Xinyi Gao, Yang Li 외

Self-supervised learning (SSL) has shown remarkable data representation capabilities across a wide range of datasets. However, when applied to real-world datasets with long-tailed distributions, performance on multiple d…

Contrastive LearningPseudo LabelSelf-Supervised Learning

Class-Distribution-Aware Calibration for Long-Tailed Visual Recognition

2021-09-11 · Mobarakol Islam, Lalithkumar Seenivasan, Hongliang Ren, Ben Glocker

Despite impressive accuracy, deep neural networks are often miscalibrated and tend to overly confident predictions. Recent techniques like temperature scaling (TS) and label smoothing (LS) show effectiveness in obtaining…

RICASSO: Reinforced Imbalance Learning with Class-Aware Self-Supervised Outliers Exposure

2024-10-14 · Xuan Zhang, Sin Chee Chin, Tingxuan Gao, Wenming Yang

In real-world scenarios, deep learning models often face challenges from both imbalanced (long-tailed) and out-of-distribution (OOD) data. However, existing joint methods rely on real OOD data, which leads to unnecessary…

Angular Gaussian Supervised Contrastive Learning for Long-Tailed Electrocardiogram Arrhythmia Diagnosis

2026-07-16 · Jin Dai, Qiuzhen Zhang, Chenyun Dai, Danmei Lan 외 arxiv

Long-tailed label distributions reduce the reliability of deep learning for electrocardiogram (ECG) arrhythmia diagnosis, particularly for clinically important but rare abnormalities. Existing rebalancing and logit adjus…

Representation LearningContrastive Learning