Optimizing Hyperparameters in CNNs using Bilevel Programming in Time Series Data
Hyperparameter optimization has remained a central topic within the machine learning community due to its ability to produce state-of-the-art results. With the recent interest growing in the usage of CNNs for time series prediction, we propose the notion of optimizing Hyperparameters in CNNs for the purpose of time series prediction. In this position paper, we give away the idea of modeling the concerned hyperparameter optimization problem using bilevel programming.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningHyperparameter OptimizationPositionPredictionTime SeriesTime Series AnalysisTime Series PredictionSimilar Papers 제목 키워드 기반
Bilevel Programming for Hyperparameter Optimization and Meta-Learning
We introduce a framework based on bilevel programming that unifies gradient-based hyperparameter optimization and meta-learning. We show that an approximate version of the bilevel problem can be solved by taking into exp…
Few-Shot LearningHyperparameter OptimizationMeta-LearningA Linear Programming Enhanced Genetic Algorithm for Hyperparameter Tuning in Machine Learning
In this paper, we formulate the hyperparameter tuning problem in machine learning as a bilevel program. The bilevel program is solved using a micro genetic algorithm that is enhanced with a linear program. While the gene…
Handling Imbalanced Classification Problems With Support Vector Machines via Evolutionary Bilevel Optimization
Support vector machines (SVMs) are popular learning algorithms to deal with binary classification problems. They traditionally assume equal misclassification costs for each class; however, real-world problems may have an…
Bilevel OptimizationBinary ClassificationClassificationimbalanced classificationSystematic Evaluation of Trade-Offs in Motion Planning Algorithms for Optimal Industrial Robotic Work Cell Design
The performance of industrial robotic work cells depends on optimizing various hyperparameters referring to the cell layout, such as robot base placement, tool placement, and kinematic design. Achieving this requires a b…
Bilevel OptimizationMotion PlanningSelf-Tuning Networks: Bilevel Optimization of Hyperparameters using Structured Best-Response Functions
Hyperparameter optimization can be formulated as a bilevel optimization problem, where the optimal parameters on the training set depend on the hyperparameters. We aim to adapt regularization hyperparameters for neural n…
Bilevel OptimizationData AugmentationHyperparameter Optimization