paper-with-me

홈 › Papers

A Deep Learning Approach to Unsupervised Ensemble Learning

2016-02-06 · Uri Shaham, Xiuyuan Cheng, Omer Dror, Ariel Jaffe, Boaz Nadler, Joseph Chang, Yuval Kluger

We show how deep learning methods can be applied in the context of crowdsourcing and unsupervised ensemble learning. First, we prove that the popular model of Dawid and Skene, which assumes that all classifiers are conditionally independent, is {\em equivalent} to a Restricted Boltzmann Machine (RBM) with a single hidden node. Hence, under this model, the posterior probabilities of the true labels can be instead estimated via a trained RBM. Next, to address the more general case, where classifiers may strongly violate the conditional independence assumption, we propose to apply RBM-based Deep Neural Net (DNN). Experimental results on various simulated and real-world datasets demonstrate that our proposed DNN approach outperforms other state-of-the-art methods, in particular when the data violates the conditional independence assumption.

📄 PDF Abstract BibTeX arXiv:1602.02285

Code (1)

ushaham/RBMpaper 공식 구현

Tasks

Deep LearningEnsemble Learning

Similar Papers 제목 키워드 기반

Unsupervised Ensemble Classification with Sequential and Networked Data

2019-06-22 · Panagiotis A. Traganitis, Georgios B. Giannakis

Ensemble learning, the machine learning paradigm where multiple algorithms are combined, has exhibited promising perfomance in a variety of tasks. The present work focuses on unsupervised ensemble classification. The ter…

ClassificationEnsemble LearningGeneral Classification

Unsupervised Anomaly Detection Ensembles using Item Response Theory

2021-06-11 · Sevvandi Kandanaarachchi

Constructing an ensemble from a heterogeneous set of unsupervised anomaly detection methods is challenging because the class labels or the ground truth is unknown. Thus, traditional ensemble techniques that use the respo…

Anomaly DetectionUnsupervised Anomaly Detection

Ensemble Distillation for Unsupervised Constituency Parsing

2023-10-03 · Behzad Shayegh, Yanshuai Cao, Xiaodan Zhu, Jackie C. K. Cheung 외

We investigate the unsupervised constituency parsing task, which organizes words and phrases of a sentence into a hierarchical structure without using linguistically annotated data. We observe that existing unsupervised …

Constituency Grammar InductionConstituency ParsingSentence

Automatic Unsupervised Ensemble Outlier Model Selection--Extended Version

2026-05-15 · Hong-Phuc Phan, Tuan-Anh Vu, Tung Kieu, Son Ha Xuan 외 arxiv

Unsupervised outlier detection is attractive because it eliminates the need for labeled data. Moreover, forming multi-model ensembles can improve detection robustness. However, composing an ensemble without labeled data …

Outlier Detection

Error Diversity Matters: An Error-Resistant Ensemble Method for Unsupervised Dependency Parsing

2024-12-16 · Behzad Shayegh, Hobie H. -B. Lee, Xiaodan Zhu, Jackie Chi Kit Cheung 외

We address unsupervised dependency parsing by building an ensemble of diverse existing models through post hoc aggregation of their output dependency parse structures. We observe that these ensembles often suffer from lo…

Dependency ParsingDiversityUnsupervised Dependency Parsing