paper-with-me

홈 › Papers

A Survey of Deep Long-Tail Classification Advancements

2024-04-24 · Charika De Alvis, Suranga Seneviratne

Many data distributions in the real world are hardly uniform. Instead, skewed and long-tailed distributions of various kinds are commonly observed. This poses an interesting problem for machine learning, where most algorithms assume or work well with uniformly distributed data. The problem is further exacerbated by current state-of-the-art deep learning models requiring large volumes of training data. As such, learning from imbalanced data remains a challenging research problem and a problem that must be solved as we move towards more real-world applications of deep learning. In the context of class imbalance, state-of-the-art (SOTA) accuracies on standard benchmark datasets for classification typically fall less than 75%, even for less challenging datasets such as CIFAR100. Nonetheless, there has been progress in this niche area of deep learning. To this end, in this survey, we provide a taxonomy of various methods proposed for addressing the problem of long-tail classification, focusing on works that happened in the last few years under a single mathematical framework. We also discuss standard performance metrics, convergence studies, feature distribution and classifier analysis. We also provide a quantitative comparison of the performance of different SOTA methods and conclude the survey by discussing the remaining challenges and future research direction.

📄 PDF Abstract BibTeX arXiv:2404.15593

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationDeep LearningSurvey

Similar Papers 제목 키워드 기반

Multimodal Pretraining, Adaptation, and Generation for Recommendation: A Survey

2024-03-31 · Qijiong Liu, Jieming Zhu, Yanting Yang, Quanyu Dai 외

Personalized recommendation serves as a ubiquitous channel for users to discover information tailored to their interests. However, traditional recommendation models primarily rely on unique IDs and categorical features f…

Recommendation SystemsSurvey

A Survey on Long Video Generation: Challenges, Methods, and Prospects

2024-03-25 · Chengxuan Li, Di Huang, Zeyu Lu, Yang Xiao 외

Video generation is a rapidly advancing research area, garnering significant attention due to its broad range of applications. One critical aspect of this field is the generation of long-duration videos, which presents u…

SurveyVideo Generation

From S4 to Mamba: A Comprehensive Survey on Structured State Space Models

2025-03-22 · Shriyank Somvanshi, Md Monzurul Islam, Mahmuda Sultana Mimi, Sazzad Bin Bashar Polock 외

Recent advancements in sequence modeling have led to the emergence of Structured State Space Models (SSMs) as an efficient alternative to Recurrent Neural Networks (RNNs) and Transformers, addressing challenges in long-r…

Computational EfficiencyMambaspeech-recognitionSpeech Recognition+3

A Survey on Neural Question Generation: Methods, Applications, and Prospects

2024-02-28 · Shasha Guo, Lizi Liao, Cuiping Li, Tat-Seng Chua

In this survey, we present a detailed examination of the advancements in Neural Question Generation (NQG), a field leveraging neural network techniques to generate relevant questions from diverse inputs like knowledge ba…

Question GenerationQuestion-GenerationSurvey

Exploring the Nexus of Large Language Models and Legal Systems: A Short Survey

2024-04-01 · Weicong Qin, Zhongxiang Sun

With the advancement of Artificial Intelligence (AI) and Large Language Models (LLMs), there is a profound transformation occurring in the realm of natural language processing tasks within the legal domain. The capabilit…

Reading ComprehensionRetrievalSurvey