A Deep Learning Approach to Unsupervised Ensemble Learning
We show how deep learning methods can be applied in the context of crowdsourcing and unsupervised ensemble learning. First, we prove that the popular model of Dawid and Skene, which assumes that all classifiers are conditionally independent, is {\em equivalent} to a Restricted Boltzmann Machine (RBM) with a single hidden node. Hence, under this model, the posterior probabilities of the true labels can be instead estimated via a trained RBM. Next, to address the more general case, where classifiers may strongly violate the conditional independence assumption, we propose to apply RBM-based Deep Neural Net (DNN). Experimental results on various simulated and real-world datasets demonstrate that our proposed DNN approach outperforms other state-of-the-art methods, in particular when the data violates the conditional independence assumption.
Code (1)
Tasks
Deep LearningEnsemble LearningSimilar Papers 제목 키워드 기반
Unsupervised Ensemble Classification with Sequential and Networked Data
Ensemble learning, the machine learning paradigm where multiple algorithms are combined, has exhibited promising perfomance in a variety of tasks. The present work focuses on unsupervised ensemble classification. The ter…
ClassificationEnsemble LearningGeneral ClassificationUnsupervised Anomaly Detection Ensembles using Item Response Theory
Constructing an ensemble from a heterogeneous set of unsupervised anomaly detection methods is challenging because the class labels or the ground truth is unknown. Thus, traditional ensemble techniques that use the respo…
Anomaly DetectionUnsupervised Anomaly DetectionEnsemble Distillation for Unsupervised Constituency Parsing
We investigate the unsupervised constituency parsing task, which organizes words and phrases of a sentence into a hierarchical structure without using linguistically annotated data. We observe that existing unsupervised …
Constituency Grammar InductionConstituency ParsingSentenceAutomatic Unsupervised Ensemble Outlier Model Selection--Extended Version
Unsupervised outlier detection is attractive because it eliminates the need for labeled data. Moreover, forming multi-model ensembles can improve detection robustness. However, composing an ensemble without labeled data …
Outlier DetectionError Diversity Matters: An Error-Resistant Ensemble Method for Unsupervised Dependency Parsing
We address unsupervised dependency parsing by building an ensemble of diverse existing models through post hoc aggregation of their output dependency parse structures. We observe that these ensembles often suffer from lo…
Dependency ParsingDiversityUnsupervised Dependency Parsing