paper-with-me

Papers

Learning Kernels for Structured Prediction using Polynomial Kernel Transformations

2016-01-07 · Chetan Tonde, Ahmed Elgammal

Learning the kernel functions used in kernel methods has been a vastly explored area in machine learning. It is now widely accepted that to obtain 'good' performance, learning a kernel function is the key challenge. In this work we focus on learning kernel representations for structured regression. We propose use of polynomials expansion of kernels, referred to as Schoenberg transforms and Gegenbaur transforms, which arise from the seminal result of Schoenberg (1938). These kernels can be thought of as polynomial combination of input features in a high dimensional reproducing kernel Hilbert space (RKHS). We learn kernels over input and output for structured data, such that, dependency between kernel features is maximized. We use Hilbert-Schmidt Independence Criterion (HSIC) to measure this. We also give an efficient, matrix decomposition-based algorithm to learn these kernel transformations, and demonstrate state-of-the-art results on several real-world datasets.

📄 PDF Abstract BibTeX arXiv:1601.01411

Code (0)

등록된 구현이 없습니다.

Tasks

PredictionStructured Prediction

Similar Papers 제목 키워드 기반

Simultaneous Twin Kernel Learning using Polynomial Transformations for Structured Prediction

2014-06-01 · CVPR 2014 6 · Chetan Tonde, Ahmed Elgammal

Many learning problems in computer vision can be posed as structured prediction problems, where the input and output instances are structured objects such as trees, graphs or strings rather than, single labels {+1, -1} o…

Gaussian ProcessesStructured Prediction

DPO Kernels: A Semantically-Aware, Kernel-Enhanced, and Divergence-Rich Paradigm for Direct Preference Optimization

2025-01-05 · Amitava Das, Suranjana Trivedy, Danush Khanna, Rajarshi Roy 외

The rapid rise of large language models (LLMs) has unlocked many applications but also underscores the challenge of aligning them with diverse values and preferences. Direct Preference Optimization (DPO) is central to al…

Instruction Following

Beyond the Gegenbauer Paradigm: q-Orthogonal Kernels for Machine Learning

2026-08-04 · Álvaro Sánchez-Paniagua Ríos, Juan P. Llerena, Alberto Lastra, Nuria Torrado 외 arxiv

The performance of Support Vector Machines (SVMs) critically depends on the kernel function choice, which enables implicit mapping of data into high-dimensional feature spaces. While classical kernels like Radial Basis F…

Spherical Random Features for Polynomial Kernels

2015-12-01 · NeurIPS 2015 12 · Jeffrey Pennington, Felix Xinnan X. Yu, Sanjiv Kumar

Compact explicit feature maps provide a practical framework to scale kernel methods to large-scale learning, but deriving such maps for many types of kernels remains a challenging open problem. Among the commonly used ke…

General Classification

Fast Sketching of Polynomial Kernels of Polynomial Degree

2021-08-21 · Zhao Song, David P. Woodruff, Zheng Yu, Lichen Zhang

Kernel methods are fundamental in machine learning, and faster algorithms for kernel approximation provide direct speedups for many core tasks in machine learning. The polynomial kernel is especially important as other k…

ARCBIG-bench Machine Learning