Unsupervised Ensemble Classification with Sequential and Networked Data
Ensemble learning, the machine learning paradigm where multiple algorithms are combined, has exhibited promising perfomance in a variety of tasks. The present work focuses on unsupervised ensemble classification. The term unsupervised refers to the ensemble combiner who has no knowledge of the ground-truth labels that each classifier has been trained on. While most prior works on unsupervised ensemble classification are designed for independent and identically distributed (i.i.d.) data, the present work introduces an unsupervised scheme for learning from ensembles of classifiers in the presence of data dependencies. Two types of data dependencies are considered: sequential data and networked data whose dependencies are captured by a graph. Moment matching and Expectation Maximization algorithms are developed for the aforementioned cases, and their performance is evaluated on synthetic and real datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationEnsemble LearningGeneral ClassificationSimilar Papers 제목 키워드 기반
Networked Information Aggregation for Binary Classification
We study networked binary classification on a directed acyclic graph (DAG) where each agent observes only a subset of the feature columns of a shared dataset. Agents act sequentially along the DAG: each receives predicti…
Binary ClassificationAutomatic Unsupervised Ensemble Outlier Model Selection--Extended Version
Unsupervised outlier detection is attractive because it eliminates the need for labeled data. Moreover, forming multi-model ensembles can improve detection robustness. However, composing an ensemble without labeled data …
Outlier DetectionUnsupervised Boosting-based Autoencoder Ensembles for Outlier Detection
Autoencoders, as a dimensionality reduction technique, have been recently applied to outlier detection. However, neural networks are known to be vulnerable to overfitting, and therefore have limited potential in the unsu…
Dimensionality ReductionDiversityOutlier DetectionUnsupervised Real Time Prediction of Faults Using the Support Vector Machine
This paper aims at improving the classification accuracy of a Support Vector Machine (SVM) classifier with Sequential Minimal Optimization (SMO) training algorithm in order to properly classify failure and normal instanc…
Sequential Ensemble Learning for Outlier Detection: A Bias-Variance Perspective
Ensemble methods for classification and clustering have been effectively used for decades, while ensemble learning for outlier detection has only been studied recently. In this work, we design a new ensemble approach for…
Binary ClassificationClusteringEnsemble LearningGeneral Classification+2