Multilabel Classification using Bayesian Compressed Sensing
In this paper, we present a Bayesian framework for multilabel classification using compressed sensing. The key idea in compressed sensing for multilabel classification is to first project the label vector to a lower dimensional space using a random transformation and then learn regression functions over these projections. Our approach considers both of these components in a single probabilistic model, thereby jointly optimizing over compression as well as learning tasks. We then derive an efficient variational inference scheme that provides joint posterior distribution over all the unobserved labels. The two key benefits of the model are that a) it can naturally handle datasets that have missing labels and b) it can also measure uncertainty in prediction. The uncertainty estimate provided by the model naturally allows for active learning paradigms where an oracle provides information about labels that promise to be maximally informative for the prediction task. Our experiments show significant boost over prior methods in terms of prediction performance over benchmark datasets, both in the fully labeled and the missing labels case. Finally, we also highlight various useful active learning scenarios that are enabled by the probabilistic model.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningClassificationcompressed sensingGeneral ClassificationMissing LabelsPredictionVariational InferenceSimilar Papers 제목 키워드 기반
Robust Bayesian Compressed sensing
We consider the problem of robust compressed sensing whose objective is to recover a high-dimensional sparse signal from compressed measurements corrupted by outliers. A new sparse Bayesian learning method is developed f…
compressed sensingBayesian hypothesis testing for one bit compressed sensing with sensing matrix perturbation
This letter proposes a low-computational Bayesian algorithm for noisy sparse recovery in the context of one bit compressed sensing with sensing matrix perturbation. The proposed algorithm which is called BHT-MLE comprise…
compressed sensingTwo-sample testingReview of Extreme Multilabel Classification
Extreme multi-label classification or XMLC, is an active area of interest in machine learning. Compared to traditional multi-label classification, here the number of labels is extremely large, hence, the name extreme mul…
Classificationcompressed sensingExtreme Multi-Label ClassificationMulti-Label Classification+1Bayesian Convolutional Neural Networks for Compressed Sensing Restoration
Deep Neural Networks (DNNs) have aroused great attention in Compressed Sensing (CS) restoration. However, the working mechanism of DNNs is not explainable, thereby it is unclear that how to design an optimal DNNs for CS …
Bayesian Inferencecompressed sensingCompressed Sensing for Energy-Efficient Wireless Telemonitoring: Challenges and Opportunities
As a lossy compression framework, compressed sensing has drawn much attention in wireless telemonitoring of biosignals due to its ability to reduce energy consumption and make possible the design of low-power devices. Ho…
compressed sensingEEGElectroencephalogram (EEG)