On the Semi-supervised Expectation Maximization
The Expectation Maximization (EM) algorithm is widely used as an iterative modification to maximum likelihood estimation when the data is incomplete. We focus on a semi-supervised case to learn the model from labeled and unlabeled samples. Existing work in the semi-supervised case has focused mainly on performance rather than convergence guarantee, however we focus on the contribution of the labeled samples to the convergence rate. The analysis clearly demonstrates how the labeled samples improve the convergence rate for the exponential family mixture model. In this case, we assume that the population EM (EM with unlimited data) is initialized within the neighborhood of global convergence for the population EM that consists solely of samples that have not been labeled. The analysis for the labeled samples provides a comprehensive description of the convergence rate for the Gaussian mixture model. In addition, we extend the findings for labeled samples and offer an alternative proof for the population EM's convergence rate with unlabeled samples for the symmetric mixture of two Gaussians.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Deep Expectation-Maximization for Semi-Supervised Lung Cancer Screening
We present a semi-supervised algorithm for lung cancer screening in which a 3D Convolutional Neural Network (CNN) is trained using the Expectation-Maximization (EM) meta-algorithm. Semi-supervised learning allows a small…
Semi-supervised Contrastive Outlier removal for Pseudo Expectation Maximization (SCOPE)
Semi-supervised learning is the problem of training an accurate predictive model by combining a small labeled dataset with a presumably much larger unlabeled dataset. Many methods for semi-supervised deep learning have b…
Contrastive LearningWeakly- and Semi-Supervised Object Detection with Expectation-Maximization Algorithm
Object detection when provided image-level labels instead of instance-level labels (i.e., bounding boxes) during training is an important problem in computer vision, since large scale image datasets with instance-level l…
object-detectionObject DetectionSemi-Supervised Object DetectionBayesian Pseudo Labels: Expectation Maximization for Robust and Efficient Semi-Supervised Segmentation
This paper concerns pseudo labelling in segmentation. Our contribution is fourfold. Firstly, we present a new formulation of pseudo-labelling as an Expectation-Maximization (EM) algorithm for clear statistical interpreta…
Image SegmentationMedical Image SegmentationPseudo LabelSegmentation+3Generalized Expectation Maximization Framework for Blind Image Super Resolution
Learning-based methods for blind single image super resolution (SISR) conduct the restoration by a learned mapping between high-resolution (HR) images and their low-resolution (LR) counterparts degraded with arbitrary bl…
Image RestorationImage Super-ResolutionSuper-Resolution