paper-with-me

홈 › Papers

Kernelized Support Tensor Train Machines

2020-01-02 · Cong Chen, Kim Batselier, Wenjian Yu, Ngai Wong

Tensor, a multi-dimensional data structure, has been exploited recently in the machine learning community. Traditional machine learning approaches are vector- or matrix-based, and cannot handle tensorial data directly. In this paper, we propose a tensor train (TT)-based kernel technique for the first time, and apply it to the conventional support vector machine (SVM) for image classification. Specifically, we propose a kernelized support tensor train machine that accepts tensorial input and preserves the intrinsic kernel property. The main contributions are threefold. First, we propose a TT-based feature mapping procedure that maintains the TT structure in the feature space. Second, we demonstrate two ways to construct the TT-based kernel function while considering consistency with the TT inner product and preservation of information. Third, we show that it is possible to apply different kernel functions on different data modes. In principle, our method tensorizes the standard SVM on its input structure and kernel mapping scheme. Extensive experiments are performed on real-world tensor data, which demonstrates the superiority of the proposed scheme under few-sample high-dimensional inputs.

📄 PDF Abstract BibTeX arXiv:2001.00360

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine Learningimage-classificationImage Classification

Methods 이 논문이 사용한 방법론

SVM A Support Vector Machine, or SVM, is a non-parametric supervised learning model. For non-linear classification and regression, they utilise the kernel trick to map inputs…

Similar Papers 제목 키워드 기반

Kernelized Support Tensor Machines

2017-08-01 · ICML 2017 8 · Lifang He, Chun-Ta Lu, Guixiang Ma, Shen Wang 외

In the context of supervised tensor learning, preserving the structural information and exploiting the discriminative nonlinear relationships of tensor data are crucial for improving the performance of learning task…

Multi-Way Multi-Level Kernel Modeling for Neuroimaging Classification

2017-07-01 · CVPR 2017 7 · Lifang He, Chun-Ta Lu, Hao Ding, Shen Wang 외

Owing to prominence as a diagnostic tool for probing the neural correlates of cognition, neuroimaging tensor data has been the focus of intense investigation. Although many supervised tensor learning approaches have been…

ClassificationDiagnosticGeneral Classification

Scalable Nonlinear AUC Maximization Methods

2017-10-02 · Majdi Khalid, Indrakshi Ray, Hamidreza Chitsaz

The area under the ROC curve (AUC) is a measure of interest in various machine learning and data mining applications. It has been widely used to evaluate classification performance on heavily imbalanced data. The kerneli…

General Classification

Large Scale, Large Margin Classification using Indefinite Similarity Measures

2014-05-27 · Omid Aghazadeh, Stefan Carlsson

Despite the success of the popular kernelized support vector machines, they have two major limitations: they are restricted to Positive Semi-Definite (PSD) kernels, and their training complexity scales at least quadratic…

ClassificationGeneral Classification

Multi-Merge Budget Maintenance for Stochastic Gradient Descent SVM Training

2018-06-26 · Sahar Qaadan, Tobias Glasmachers

Budgeted Stochastic Gradient Descent (BSGD) is a state-of-the-art technique for training large-scale kernelized support vector machines. The budget constraint is maintained incrementally by merging two points whenever th…