Understanding Partial Multi-Label Learning via Mutual Information
To deal with ambiguities in partial multilabel learning (PML), state-of-the-art methods perform disambiguation by identifying ground-truth labels directly. However, there is an essential question:“Can the ground-truth labels be identified precisely?". If yes, “How can the ground-truth labels be found?". This paper provides affirmative answers to these questions. Instead of adopting hand-made heuristic strategy, we propose a novel Mutual Information Label Identification for Partial Multilabel Learning (MILI-PML), which is derived from a clear probabilistic formulation and could be easily interpreted theoretically from the mutual information perspective, as well as naturally incorporates the feature/label relevancy considerations. Extensive experiments on synthetic and real-world datasets clearly demonstrate the superiorities of the proposed MILI-PML.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi-Label LearningSimilar Papers 제목 키워드 기반
Deep Mutual Learning among Partially Labeled Datasets for Multi-Organ Segmentation
The task of labeling multiple organs for segmentation is a complex and time-consuming process, resulting in a scarcity of comprehensively labeled multi-organ datasets while the emergence of numerous partially labeled dat…
Organ SegmentationPartially Labeled DatasetsSegmentationWhich Information Matters? Dissecting Human-written Multi-document Summaries with Partial Information Decomposition
Understanding the nature of high-quality summaries is crucial to further improve the performance of multi-document summarization. We propose an approach to characterize human-written summaries using partial information d…
Document SummarizationMulti-Document SummarizationFundamental limits of community detection from multi-view data: multi-layer, dynamic and partially labeled block models
Multi-view data arises frequently in modern network analysis e.g. relations of multiple types among individuals in social network analysis, longitudinal measurements of interactions among observational units, annotated n…
Community DetectionStochastic Block ModelMutual Information based labelling and comparing clusters
After a clustering solution is generated automatically, labelling these clusters becomes important to help understanding the results. In this paper, we propose to use a Mutual Information based method to label clusters o…
ArticlesClusteringRethinking Self-Supervised Learning Within the Framework of Partial Information Decomposition
Self Supervised learning (SSL) has demonstrated its effectiveness in feature learning from unlabeled data. Regarding this success, there have been some arguments on the role that mutual information plays within the SSL f…
Representation LearningSelf-Supervised Learning