Robust Multi-Output Learning with Highly Incomplete Data via Restricted Boltzmann Machines
In a standard multi-output classification scenario, both features and labels of training data are partially observed. This challenging issue is widely witnessed due to sensor or database failures, crowd-sourcing and noisy communication channels in industrial data analytic services. Classic methods for handling multi-output classification with incomplete supervision information usually decompose the problem into an imputation stage that reconstructs the missing training information, and a learning stage that builds a classifier based on the imputed training set. These methods fail to fully leverage the dependencies between features and labels. In order to take full advantage of these dependencies we consider a purely probabilistic setting in which the features imputation and multi-label classification problems are jointly solved. Indeed, we show that a simple Restricted Boltzmann Machine can be trained with an adapted algorithm based on mean-field equations to efficiently solve problems of inductive and transductive learning in which both features and labels are missing at random. The effectiveness of the approach is demonstrated empirically on various datasets, with particular focus on a real-world Internet-of-Things security dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral ClassificationImputationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONTransductive LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Perception-Distortion Trade-off with Restricted Boltzmann Machines
In this work, we introduce a new procedure for applying Restricted Boltzmann Machines (RBMs) to missing data inference tasks, based on linearization of the effective energy function governing the distribution of observat…
Latent Execution for Neural Program Synthesis
Program synthesis from input-output (IO) examples has been a long-standing challenge. While recent works demonstrated limited success on domain-specific languages (DSL), it remains highly challenging to apply them to rea…
C++ codeProgram SynthesisMultitask Emotion Recognition with Incomplete Labels
We train a unified model to perform three tasks: facial action unit detection, expression classification, and valence-arousal estimation. We address two main challenges of learning the three tasks. First, most existing d…
Action Unit DetectionArousal EstimationEmotion RecognitionFacial Action Unit DetectionHigh-order Correlation Preserved Incomplete Multi-view Subspace Clustering
Incomplete multi-view clustering aims to exploit theinformation of multiple incomplete views to partition data into their clusters. Existing methods only utilize the pair-wise sample correlation and pair-wise view correl…
ClusteringIncomplete multi-view clusteringMulti-view Subspace ClusteringVocal Bursts Intensity PredictionLatent Execution for Neural Program Synthesis Beyond Domain-Specific Languages
Program synthesis from input-output (IO) examples has been a long-standing challenge. While recent works demonstrated limited success on domain-specific languages (DSL), it remains highly challenging to apply them to rea…
C++ codeProgram Synthesis