Compact Learning for Multi-Label Classification
Multi-label classification (MLC) studies the problem where each instance is associated with multiple relevant labels, which leads to the exponential growth of output space. MLC encourages a popular framework named label compression (LC) for capturing label dependency with dimension reduction. Nevertheless, most existing LC methods failed to consider the influence of the feature space or misguided by original problematic features, so that may result in performance degeneration. In this paper, we present a compact learning (CL) framework to embed the features and labels simultaneously and with mutual guidance. The proposal is a versatile concept, hence the embedding way is arbitrary and independent of the subsequent learning process. Following its spirit, a simple yet effective implementation called compact multi-label learning (CMLL) is proposed to learn a compact low-dimensional representation for both spaces. CMLL maximizes the dependence between the embedded spaces of the labels and features, and minimizes the loss of label space recovery concurrently. Theoretically, we provide a general analysis for different embedding methods. Practically, we conduct extensive experiments to validate the effectiveness of the proposed method.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationDimensionality ReductionGeneral ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONMulti-Label LearningSimilar Papers 제목 키워드 기반
$\mathcal{G}$-softmax: Improving Intra-class Compactness and Inter-class Separability of Features
Intra-class compactness and inter-class separability are crucial indicators to measure the effectiveness of a model to produce discriminative features, where intra-class compactness indicates how close the features with …
General ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONExplainable Knowledge Distillation for On-device Chest X-Ray Classification
Automated multi-label chest X-rays (CXR) image classification has achieved substantial progress in clinical diagnosis via utilizing sophisticated deep learning approaches. However, most deep models have high computationa…
Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)image-classificationImage Classification+2Query2Label: A Simple Transformer Way to Multi-Label Classification
This paper presents a simple and effective approach to solving the multi-label classification problem. The proposed approach leverages Transformer decoders to query the existence of a class label. The use of Transformer …
ClassificationDecoderMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONKnowledge Distillation from Single to Multi Labels: an Empirical Study
Knowledge distillation (KD) has been extensively studied in single-label image classification. However, its efficacy for multi-label classification remains relatively unexplored. In this study, we firstly investigate the…
Classificationimage-classificationImage ClassificationKnowledge Distillation+2Pose Guided Attention for Multi-label Fashion Image Classification
We propose a compact framework with guided attention for multi-label classification in the fashion domain. Our visual semantic attention model (VSAM) is supervised by automatic pose extraction creating a discriminative f…
ClassificationGeneral Classificationimage-classificationImage Classification+2