paper-with-me

Papers

Robust Feature Learning and Global Variance-Driven Classifier Alignment for Long-Tail Class Incremental Learning

2023-11-02 · Jayateja Kalla, Soma Biswas

This paper introduces a two-stage framework designed to enhance long-tail class incremental learning, enabling the model to progressively learn new classes, while mitigating catastrophic forgetting in the context of long-tailed data distributions. Addressing the challenge posed by the under-representation of tail classes in long-tail class incremental learning, our approach achieves classifier alignment by leveraging global variance as an informative measure and class prototypes in the second stage. This process effectively captures class properties and eliminates the need for data balancing or additional layer tuning. Alongside traditional class incremental learning losses in the first stage, the proposed approach incorporates mixup classes to learn robust feature representations, ensuring smoother boundaries. The proposed framework can seamlessly integrate as a module with any class incremental learning method to effectively handle long-tail class incremental learning scenarios. Extensive experimentation on the CIFAR-100 and ImageNet-Subset datasets validates the approach's efficacy, showcasing its superiority over state-of-the-art techniques across various long-tail CIL settings.

📄 PDF Abstract BibTeX arXiv:2311.01227

Code (1)

jayatejak/gvalign 공식 구현 pytorch

Tasks

class-incremental learningClass Incremental LearningIncremental Learning

Methods 이 논문이 사용한 방법론

Mixup Mixup is a data augmentation technique that generates a weighted combination of random image pairs from the training data. Given two images and their ground truth labels:…

Similar Papers 제목 키워드 기반

FedDr+: Stabilizing Dot-regression with Global Feature Distillation for Federated Learning

2024-06-04 · Seongyoon Kim, Minchan Jeong, Sungnyun Kim, Sungwoo Cho 외

Federated Learning (FL) has emerged as a pivotal framework for the development of effective global models (global FL) or personalized models (personalized FL) across clients with heterogeneous, non-iid data distribution.…

Federated Learningregression

How Biased are Your Features?: Computing Fairness Influence Functions with Global Sensitivity Analysis

2022-06-01 · Bishwamittra Ghosh, Debabrota Basu, Kuldeep S. Meel

Fairness in machine learning has attained significant focus due to the widespread application in high-stake decision-making tasks. Unregulated machine learning classifiers can exhibit bias towards certain demographic gro…

BIG-bench Machine LearningDecision MakingFairnessSensitivity

Personalized Federated Learning with Feature Alignment and Classifier Collaboration

2023-06-20 · Jian Xu, Xinyi Tong, Shao-Lun Huang

Data heterogeneity is one of the most challenging issues in federated learning, which motivates a variety of approaches to learn personalized models for participating clients. One such approach in deep neural networks ba…

Federated LearningPersonalized Federated LearningRepresentation Learning

Coarse-to-Fine Point Cloud Registration with SE(3)-Equivariant Representations

2022-10-05 · Cheng-Wei Lin, Tung-I Chen, Hsin-Ying Lee, Wen-Chin Chen 외

Point cloud registration is a crucial problem in computer vision and robotics. Existing methods either rely on matching local geometric features, which are sensitive to the pose differences, or leverage global shapes, wh…

Point Cloud Registration

FedLoGe: Joint Local and Generic Federated Learning under Long-tailed Data

2024-01-17 · Zikai Xiao, Zihan Chen, Liyinglan Liu, Yang Feng 외

Federated Long-Tailed Learning (Fed-LT), a paradigm wherein data collected from decentralized local clients manifests a globally prevalent long-tailed distribution, has garnered considerable attention in recent times. In…

Federated LearningPersonalized Federated LearningRepresentation Learning