Learning Kernels over Strings using Gaussian Processes
Non-contiguous word sequences are widely known to be important in modelling natural language. However they not explicitly encoded in common text representations. In this work we propose a model for text processing using string kernels, capable of flexibly representing non-contiguous sequences. Specifically, we derive a vectorised version of the string kernel algorithm and their gradients, allowing efficient hyperparameter optimisation as part of a Gaussian Process framework. Experiments on synthetic data and text regression for emotion analysis show the promise of this technique.
Code (0)
등록된 구현이 없습니다.
Tasks
Emotion RecognitionGaussian ProcessesregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
GAUCHE: A Library for Gaussian Processes in Chemistry
We introduce GAUCHE, a library for GAUssian processes in CHEmistry. Gaussian processes have long been a cornerstone of probabilistic machine learning, affording particular advantages for uncertainty quantification and Ba…
Bayesian OptimisationGaussian ProcessesUncertainty QuantificationSimultaneous Twin Kernel Learning using Polynomial Transformations for Structured Prediction
Many learning problems in computer vision can be posed as structured prediction problems, where the input and output instances are structured objects such as trees, graphs or strings rather than, single labels {+1, -1} o…
Gaussian ProcessesStructured PredictionLearning Structural Kernels for Natural Language Processing
Structural kernels are a flexible learning paradigm that has been widely used in Natural Language Processing. However, the problem of model selection in kernel-based methods is usually overlooked. Previous approaches mos…
Gaussian ProcessesHyperparameter OptimizationModel SelectionBOSS: Bayesian Optimization over String Spaces
This article develops a Bayesian optimization (BO) method which acts directly over raw strings, proposing the first uses of string kernels and genetic algorithms within BO loops. Recent applications of BO over strings ha…
Bayesian OptimizationGaussian Process Kernels for Pattern Discovery and Extrapolation
Gaussian processes are rich distributions over functions, which provide a Bayesian nonparametric approach to smoothing and interpolation. We introduce simple closed form kernels that can be used with Gaussian processes t…
Gaussian Processes