Bottom-up Hierarchical Classification Using Confusion-based Logit Compression
In this work, we propose a method to efficiently compute label posteriors of a base flat classifier in the presence of few validation examples within a bottom-up hierarchical inference framework. A stand-alone validation set (not used to train the base classifier) is preferred for posterior estimation to avoid overfitting the base classifier, however a small validation set limits the number of features one can effectively use. We propose a simple, yet robust, logit vector compression approach based on generalized logits and label confusions for the task of label posterior estimation within the context of hierarchical classification. Extensive comparative experiments with other compression techniques are provided across multiple sized validation sets, and a comparison with related hierarchical classification approaches is also conducted. The proposed approach mitigates the problem of not having enough validation examples for reliable posterior estimation while maintaining strong hierarchical classification performance.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationSimilar Papers 제목 키워드 기반
Logits DeConfusion with CLIP for Few-Shot Learning
With its powerful visual-language alignment capability, CLIP performs well in zero-shot and few-shot learning tasks. However, we found in experiments that CLIP's logits suffer from serious inter-class confusion problems …
Few-Shot LearningHierarchical confusion matrix for classification performance evaluation
In this work we propose a novel concept of a hierarchical confusion matrix, opening the door for popular confusion matrix based (flat) evaluation measures from binary classification problems, while considering the peculi…
Binary ClassificationClassificationHierarchical Knowledge Structuring for Effective Federated Learning in Heterogeneous Environments
Federated learning enables collaborative model training across distributed entities while maintaining individual data privacy. A key challenge in federated learning is balancing the personalization of models for local cl…
Federated LearningResolving Task Confusion in Dynamic Expansion Architectures for Class Incremental Learning
The dynamic expansion architecture is becoming popular in class incremental learning, mainly due to its advantages in alleviating catastrophic forgetting. However, task confusion is not well assessed within this framewor…
class-incremental learningClass Incremental LearningIncremental LearningIncremental Learning on CIFAR100-B0(5steps of 20 classes)+1Study of Phonemes Confusions in Hierarchical Automatic Phoneme Recognition System
In this paper, we have analyzed the impact of confusions on the robustness of phoneme recognitions system. The confusions are detected at the pronunciation and the confusions matrices of the phoneme recognizer. The confu…
Automatic Phoneme RecognitionPhoneme Recognition