Semi-supervised structured output prediction by local linear regression and sub-gradient descent
We propose a novel semi-supervised structured output prediction method based on local linear regression in this paper. The existing semi-supervise structured output prediction methods learn a global predictor for all the data points in a data set, which ignores the differences of local distributions of the data set, and the effects to the structured output prediction. To solve this problem, we propose to learn the missing structured outputs and local predictors for neighborhoods of different data points jointly. Using the local linear regression strategy, in the neighborhood of each data point, we propose to learn a local linear predictor by minimizing both the complexity of the predictor and the upper bound of the structured prediction loss. The minimization problem is solved by sub-gradient descent algorithms. We conduct experiments over two benchmark data sets, and the results show the advantages of the proposed method.
Code (0)
등록된 구현이 없습니다.
Tasks
PredictionregressionStructured PredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Semi-supervised learning of local structured output predictors
In this paper, we study the problem of semi-supervised structured output prediction, which aims to learn predictors for structured outputs, such as sequences, tree nodes, vectors, etc., from a set of data points of both …
SentenceStructured PredictionLarge Margin Semi-supervised Structured Output Learning
In structured output learning, obtaining labelled data for real-world applications is usually costly, while unlabelled examples are available in abundance. Semi-supervised structured classification has been developed to …
Structured PredictionManifold regularization in structured output space for semi-supervised structured output prediction
Structured output prediction aims to learn a predictor to predict a structured output from a input data vector. The structured outputs include vector, tree, sequence, etc. We usually assume that we have a training set of…
Semi-supervised Learning with the EM Algorithm: A Comparative Study between Unstructured and Structured Prediction
Semi-supervised learning aims to learn prediction models from both labeled and unlabeled samples. There has been extensive research in this area. Among existing work, generative mixture models with Expectation-Maximizati…
PredictionStructured PredictionFeature Ranking for Semi-supervised Learning
The data made available for analysis are becoming more and more complex along several directions: high dimensionality, number of examples and the amount of labels per example. This poses a variety of challenges for the e…
ClassificationGeneral ClassificationHierarchical Multi-label ClassificationMulti-Label Classification+3