paper-with-me

Papers

Efficient Tensor Kernel methods for sparse regression

2020-03-23 · Feliks Hibraj, Marcello Pelillo, Saverio Salzo, Massimiliano Pontil

Recently, classical kernel methods have been extended by the introduction of suitable tensor kernels so to promote sparsity in the solution of the underlying regression problem. Indeed, they solve an lp-norm regularization problem, with p=m/(m-1) and m even integer, which happens to be close to a lasso problem. However, a major drawback of the method is that storing tensors requires a considerable amount of memory, ultimately limiting its applicability. In this work we address this problem by proposing two advances. First, we directly reduce the memory requirement, by intriducing a new and more efficient layout for storing the data. Second, we use a Nystrom-type subsampling approach, which allows for a training phase with a smaller number of data points, so to reduce the computational cost. Experiments, both on synthetic and read datasets, show the effectiveness of the proposed improvements. Finally, we take case of implementing the cose in C++ so to further speed-up the computation.

📄 PDF Abstract BibTeX arXiv:2003.10482

Code (0)

등록된 구현이 없습니다.

Tasks

regression

Similar Papers 제목 키워드 기반

Correlating Time Series with Interpretable Convolutional Kernels

2024-09-02 · Xinyu Chen, HanQin Cai, Fuqiang Liu, Jinhua Zhao

This study addresses the problem of convolutional kernel learning in univariate, multivariate, and multidimensional time series data, which is crucial for interpreting temporal patterns in time series and supporting down…

Time Series

Tensor Sparse PCA and Face Recognition: A Novel Approach

2019-04-12 · Loc Hoang Tran, Linh Hoang Tran

Face recognition is the important field in machine learning and pattern recognition research area. It has a lot of applications in military, finance, public security, to name a few. In this paper, the combination of the …

ClassificationFace RecognitionGeneral Classificationregression

Kernel Regression of Multi-Way Data via Tensor Trains with Hadamard Overparametrization: The Dynamic Graph Flow Case

2025-09-26 · Duc Thien Nguyen, Konstantinos Slavakis, Eleftherios Kofidis, Dimitris Pados arxiv

A regression-based framework for interpretable multi-way data imputation, termed Kernel Regression via Tensor Trains with Hadamard overparametrization (KReTTaH), is introduced. KReTTaH adopts a nonparametric formulation …

Decomposable Sparse Tensor on Tensor Regression

2022-12-09 · Haiyi Mao, Jason Xiaotian Dou

Most regularized tensor regression research focuses on tensors predictors with scalars responses or vectors predictors to tensors responses. We consider the sparse low rank tensor on tensor regression where predictors $\…

regressionTensor Decomposition

Sketching for Kronecker Product Regression and P-splines

2017-12-27 · Huaian Diao, Zhao Song, Wen Sun, David P. Woodruff

TensorSketch is an oblivious linear sketch introduced in Pagh'13 and later used in Pham, Pagh'13 in the context of SVMs for polynomial kernels. It was shown in Avron, Nguyen, Woodruff'14 that TensorSketch provides a subs…

regression