paper-with-me

Papers

Efficient Online Hyperparameter Optimization for Kernel Ridge Regression with Applications to Traffic Time Series Prediction

2018-11-01 · Hongyuan Zhan, Gabriel Gomes, Xiaoye S. Li, Kamesh Madduri, Kesheng Wu

Computational efficiency is an important consideration for deploying machine learning models for time series prediction in an online setting. Machine learning algorithms adjust model parameters automatically based on the data, but often require users to set additional parameters, known as hyperparameters. Hyperparameters can significantly impact prediction accuracy. Traffic measurements, typically collected online by sensors, are serially correlated. Moreover, the data distribution may change gradually. A typical adaptation strategy is periodically re-tuning the model hyperparameters, at the cost of computational burden. In this work, we present an efficient and principled online hyperparameter optimization algorithm for Kernel Ridge regression applied to traffic prediction problems. In tests with real traffic measurement data, our approach requires as little as one-seventh of the computation time of other tuning methods, while achieving better or similar prediction accuracy.

📄 PDF Abstract BibTeX arXiv:1811.00620

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningComputational EfficiencyHyperparameter OptimizationPredictionregressionTime SeriesTime Series AnalysisTime Series PredictionTraffic Prediction

Similar Papers 제목 키워드 기반

Efficient Hyperparameter Tuning for Large Scale Kernel Ridge Regression

2022-01-17 · Giacomo Meanti, Luigi Carratino, Ernesto de Vito, Lorenzo Rosasco

Kernel methods provide a principled approach to nonparametric learning. While their basic implementations scale poorly to large problems, recent advances showed that approximate solvers can efficiently handle massive dat…

regression

Uniform convergence for Gaussian kernel ridge regression

2025-08-15 · Paul Dommel, Rajmadan Lakshmanan arxiv

This paper establishes the first polynomial convergence rates for Gaussian kernel ridge regression (KRR) with a fixed hyperparameter in both the uniform and the $L^{2}$-norm. The uniform convergence result closes a gap i…

Hyperparameter optimization with approximate gradient

2016-02-07 · Fabian Pedregosa

Most models in machine learning contain at least one hyperparameter to control for model complexity. Choosing an appropriate set of hyperparameters is both crucial in terms of model accuracy and computationally challengi…

Hyperparameter Optimizationregression

Nonlinear Granger Causality using Kernel Ridge Regression

2023-09-10 · Wojciech "Victor" Fulmyk

I introduce a novel algorithm and accompanying Python library, named mlcausality, designed for the identification of nonlinear Granger causal relationships. This novel algorithm uses a flexible plug-in architecture that …

regression

Deep Transfer Learning with Ridge Regression

2020-06-11 · Shuai Tang, Virginia R. de Sa

The large amount of online data and vast array of computing resources enable current researchers in both industry and academia to employ the power of deep learning with neural networks. While deep models trained with mas…

regressionTransfer Learning