paper-with-me

Papers

Learning Structural Kernels for Natural Language Processing

2015-08-10 · TACL 2015 1 · Daniel Beck, Trevor Cohn, Christian Hardmeier, Lucia Specia

Structural kernels are a flexible learning paradigm that has been widely used in Natural Language Processing. However, the problem of model selection in kernel-based methods is usually overlooked. Previous approaches mostly rely on setting default values for kernel hyperparameters or using grid search, which is slow and coarse-grained. In contrast, Bayesian methods allow efficient model selection by maximizing the evidence on the training data through gradient-based methods. In this paper we show how to perform this in the context of structural kernels by using Gaussian Processes. Experimental results on tree kernels show that this procedure results in better prediction performance compared to hyperparameter optimization via grid search. The framework proposed in this paper can be adapted to other structures besides trees, e.g., strings and graphs, thereby extending the utility of kernel-based methods.

📄 PDF Abstract BibTeX arXiv:1508.02131

Code (0)

등록된 구현이 없습니다.

Tasks

Gaussian ProcessesHyperparameter OptimizationModel Selection

Similar Papers 제목 키워드 기반

A Structural Smoothing Framework For Robust Graph Comparison

2015-12-01 · NeurIPS 2015 12 · Pinar Yanardag, S. V. N. Vishwanathan

In this paper, we propose a general smoothing framework for graph kernels by taking \textit{structural similarity} into account, and apply it to derive smoothed variants of popular graph kernels. Our framework is inspi…

Stochastic Learning of Nonstationary Kernels for Natural Language Modeling

2018-01-11 · Sahil Garg, Greg Ver Steeg, Aram Galstyan

Natural language processing often involves computations with semantic or syntactic graphs to facilitate sophisticated reasoning based on structural relationships. While convolution kernels provide a powerful tool for com…

Language ModelingLanguage Modelling

State-of-the-Art Kernels for Natural Language Processing

2012-07-01 · ACL 2012 7 · Aless Moschitti, ro
Information RetrievalSemantic ParsingText Categorization

Word2Vec is a special case of Kernel Correspondence Analysis and Kernels for Natural Language Processing

2016-05-17 · Hirotaka Niitsuma, Minho Lee

We show that correspondence analysis (CA) is equivalent to defining a Gini index with appropriately scaled one-hot encoding. Using this relation, we introduce a nonlinear kernel extension to CA. This extended CA gives a …

Optimizing Memory Efficiency for Convolution Kernels on Kepler GPUs

2017-05-29 · Xiaoming Chen, Jianxu Chen, Danny Z. Chen, Xiaobo Sharon Hu

Convolution is a fundamental operation in many applications, such as computer vision, natural language processing, image processing, etc. Recent successes of convolutional neural networks in various deep learning applica…