Improving Multi-label Learning with Missing Labels by Structured Semantic Correlations
Multi-label learning has attracted significant interests in computer vision recently, finding applications in many vision tasks such as multiple object recognition and automatic image annotation. Associating multiple labels to a complex image is very difficult, not only due to the intricacy of describing the image, but also because of the incompleteness nature of the observed labels. Existing works on the problem either ignore the label-label and instance-instance correlations or just assume these correlations are linear and unstructured. Considering that semantic correlations between images are actually structured, in this paper we propose to incorporate structured semantic correlations to solve the missing label problem of multi-label learning. Specifically, we project images to the semantic space with an effective semantic descriptor. A semantic graph is then constructed on these images to capture the structured correlations between them. We utilize the semantic graph Laplacian as a smooth term in the multi-label learning formulation to incorporate the structured semantic correlations. Experimental results demonstrate the effectiveness of the proposed semantic descriptor and the usefulness of incorporating the structured semantic correlations. We achieve better results than state-of-the-art multi-label learning methods on four benchmark datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Missing LabelsMulti-Label LearningObject RecognitionSimilar Papers 제목 키워드 기반
Structured Semantic Transfer for Multi-Label Recognition with Partial Labels
Multi-label image recognition is a fundamental yet practical task because real-world images inherently possess multiple semantic labels. However, it is difficult to collect large-scale multi-label annotations due to the …
Multi-Label Image RecognitionMulti-label Image Recognition with Partial LabelsML-MG: Multi-Label Learning With Missing Labels Using a Mixed Graph
This work focuses on the problem of multi-label learning with missing labels (MLML), which aims to label each test instance with multiple class labels given training instances that have an incomplete/partial set of these…
Missing LabelsMulti-Label LearningText-Region Matching for Multi-Label Image Recognition with Missing Labels
Recently, large-scale visual language pre-trained (VLP) models have demonstrated impressive performance across various downstream tasks. Motivated by these advancements, pioneering efforts have emerged in multi-label ima…
Contrastive LearningMissing LabelsMulti-Label Image RecognitionPseudo LabelIncomplete Multi-Label Image Recognition by Co-learning Semantic-Aware Features and Label Recovery
Multi-label image recognition with incomplete labels is a challenging yet vital task in computer vision, which faces two fundamental challenges: learning semantic-aware features and recovering missing labels. In this pap…
Multi-label Learning with Missing Labels using Mixed Dependency Graphs
This work focuses on the problem of multi-label learning with missing labels (MLML), which aims to label each test instance with multiple class labels given training instances that have an incomplete/partial set of these…
Image RetrievalMissing LabelsMulti-Label LearningRetrieval+1